[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:13 dist-test-slave-8tdl krb5kdc[10328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:13 dist-test-slave-8tdl krb5kdc[10328](info): set up 2 sockets
Aug 08 02:37:13 dist-test-slave-8tdl krb5kdc[10328](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 02:37:14.841082 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:15 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:15.097718 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46105
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:46105
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:15.721290 10341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:15.722052 10341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:15.722251 10341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:15.732879 10341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:15.733080 10341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:15.733186 10341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:15.733306 10341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:15.733400 10341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:15.745803 10341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:46105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:15.748132 10341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:15.750237 10341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:15.773133 10346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:15.773975 10347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:15.774016 10349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:15.774881 10341 server_base.cc:1034] running on GCE node
I20260808 02:37:15.776141 10341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:15.778641 10341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:15.780196 10341 hybrid_clock.cc:648] HybridClock initialized: now 1786156635780096 us; error 116 us; skew 500 ppm
I20260808 02:37:15.780879 10341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:15 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156635, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:15.785138 10341 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:15.787982 10341 webserver.cc:460] Webserver started at http://127.10.20.126:34509/ using document root <none> and password file <none>
I20260808 02:37:15.789464 10341 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:15.789640 10341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:15.790105 10341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:15.794950 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "98410cd22b3842929333870e7c1d89d7"
format_stamp: "Formatted at 2026-08-08 02:37:15 on dist-test-slave-8tdl"
server_key: "671ed4c50d04472f07fa34a86a382f8a"
server_key_iv: "1102a2e0457eb3015da954cfa8c7a174"
server_key_version: "encryptionkey@0"
I20260808 02:37:15.795869 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "98410cd22b3842929333870e7c1d89d7"
format_stamp: "Formatted at 2026-08-08 02:37:15 on dist-test-slave-8tdl"
server_key: "671ed4c50d04472f07fa34a86a382f8a"
server_key_iv: "1102a2e0457eb3015da954cfa8c7a174"
server_key_version: "encryptionkey@0"
I20260808 02:37:15.805131 10341 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.002s
I20260808 02:37:15.812119 10356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:15.814810 10341 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:37:15.815177 10341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "98410cd22b3842929333870e7c1d89d7"
format_stamp: "Formatted at 2026-08-08 02:37:15 on dist-test-slave-8tdl"
server_key: "671ed4c50d04472f07fa34a86a382f8a"
server_key_iv: "1102a2e0457eb3015da954cfa8c7a174"
server_key_version: "encryptionkey@0"
I20260808 02:37:15.815412 10341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:15.837821 10341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:15.844234 10341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:15.844660 10341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:15.870808 10341 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:46105
I20260808 02:37:15.870841 10410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:46105 every 8 connection(s)
I20260808 02:37:15.873399 10341 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:15.881234 10411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:15.883930 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 10341
I20260808 02:37:15.884317 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:15.886579 10321 external_mini_cluster.cc:1428] Setting key 4d34feef272e6d052dd01e82401205a0
I20260808 02:37:15.900372 10411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7: Bootstrap starting.
I20260808 02:37:15.906392 10411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:15.908288 10411 log.cc:824] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:15.913137 10411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7: No bootstrap required, opened a new log
Aug 08 02:37:15 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:15.924057 10411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98410cd22b3842929333870e7c1d89d7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46105 } }
I20260808 02:37:15.924674 10411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:15.924932 10411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98410cd22b3842929333870e7c1d89d7, State: Initialized, Role: FOLLOWER
I20260808 02:37:15.926446 10411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98410cd22b3842929333870e7c1d89d7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46105 } }
I20260808 02:37:15.927136 10411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:15.927486 10411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:15.927734 10411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:15.930464 10411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98410cd22b3842929333870e7c1d89d7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46105 } }
I20260808 02:37:15.931617 10411 leader_election.cc:302] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98410cd22b3842929333870e7c1d89d7; no voters:
I20260808 02:37:15.932672 10411 leader_election.cc:288] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:15.932976 10417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:15.936622 10413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:15.893001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56180 (local address 127.10.20.126:46105)
0808 02:37:15.894608 (+ 1607us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:15.894638 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:15.896066 (+ 1428us) server_negotiation.cc:407] Connection header received
0808 02:37:15.906307 (+ 10241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:15.906334 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:15.907167 (+ 833us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:15.907676 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:15.911434 (+ 3758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:15.912937 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:15.915161 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:15.915998 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:15.916336 (+ 338us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:15.924382 (+ 8046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:15.924483 (+ 101us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:15.924520 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:15.924627 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:15.929002 (+ 4375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:15.930145 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:15.930153 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:15.930159 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:15.930427 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:15.931105 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:15.931112 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:15.931120 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:15.931975 (+ 855us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:15.932518 (+ 543us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:15.933887 (+ 1369us) server_negotiation.cc:299] Negotiation successful
0808 02:37:15.934438 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1160,"thread_start_us":740,"threads_started":1}
I20260808 02:37:15.937227 10411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:15.939668 10417 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [term 1 LEADER]: Becoming Leader. State: Replica: 98410cd22b3842929333870e7c1d89d7, State: Running, Role: LEADER
I20260808 02:37:15.940883 10417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98410cd22b3842929333870e7c1d89d7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46105 } }
I20260808 02:37:15.948629 10419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98410cd22b3842929333870e7c1d89d7. Latest consensus state: current_term: 1 leader_uuid: "98410cd22b3842929333870e7c1d89d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98410cd22b3842929333870e7c1d89d7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46105 } } }
I20260808 02:37:15.949236 10419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:15.949991 10418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98410cd22b3842929333870e7c1d89d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98410cd22b3842929333870e7c1d89d7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46105 } } }
I20260808 02:37:15.950457 10418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7 [sys.catalog]: This master's current role is: LEADER
W20260808 02:37:15.960678 10434 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:37:15.961055 10434 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:37:15.961321 10430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:15.964080 10430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:15.977910 10430 catalog_manager.cc:1347] Generated new cluster ID: c2cb146be26e475294c6624c683187a6
I20260808 02:37:15.978075 10430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:16.011997 10430 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:16.013705 10430 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:16.026197 10430 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98410cd22b3842929333870e7c1d89d7: Generated new TSK 0
I20260808 02:37:16.027652 10430 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:16.095526 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46105
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:16.475054 10440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:16.475458 10440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:16.475638 10440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:16.483522 10440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:16.483726 10440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:16.483927 10440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:16.494632 10440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46105
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:16.496248 10440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:16.497825 10440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:16.513186 10446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:16.513259 10447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:16.513440 10449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:16.514043 10440 server_base.cc:1034] running on GCE node
I20260808 02:37:16.514897 10440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:16.516026 10440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:16.517303 10440 hybrid_clock.cc:648] HybridClock initialized: now 1786156636517253 us; error 46 us; skew 500 ppm
I20260808 02:37:16.517746 10440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:16 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156636, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:16.521768 10440 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:16.523789 10440 webserver.cc:460] Webserver started at http://127.10.20.65:35005/ using document root <none> and password file <none>
I20260808 02:37:16.524623 10440 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:16.524804 10440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:16.525424 10440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:16.529175 10440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "d7269ed34b0c4e5d936dcd7388cf23b2"
format_stamp: "Formatted at 2026-08-08 02:37:16 on dist-test-slave-8tdl"
server_key: "1001fc3cb82ba217377a4450a8d7d221"
server_key_iv: "80d68d756d47b33a2dac541a5de009ca"
server_key_version: "encryptionkey@0"
I20260808 02:37:16.530081 10440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "d7269ed34b0c4e5d936dcd7388cf23b2"
format_stamp: "Formatted at 2026-08-08 02:37:16 on dist-test-slave-8tdl"
server_key: "1001fc3cb82ba217377a4450a8d7d221"
server_key_iv: "80d68d756d47b33a2dac541a5de009ca"
server_key_version: "encryptionkey@0"
I20260808 02:37:16.536684 10440 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:37:16.541119 10456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:16.543072 10440 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:37:16.543270 10440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "d7269ed34b0c4e5d936dcd7388cf23b2"
format_stamp: "Formatted at 2026-08-08 02:37:16 on dist-test-slave-8tdl"
server_key: "1001fc3cb82ba217377a4450a8d7d221"
server_key_iv: "80d68d756d47b33a2dac541a5de009ca"
server_key_version: "encryptionkey@0"
I20260808 02:37:16.543532 10440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:16.569757 10440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:16.575152 10440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:16.575490 10440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:16.576740 10440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:16.578635 10440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:16.578781 10440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 02:37:16.578987 10440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:16.579049 10440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:16.621201 10440 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:39765
I20260808 02:37:16.621412 10573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:39765 every 8 connection(s)
I20260808 02:37:16.622931 10440 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:16.623353 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 10440
I20260808 02:37:16.623605 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:16.624370 10321 external_mini_cluster.cc:1428] Setting key 3a2bd6169201883d1d506e7a82fdf80b
Aug 08 02:37:16 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156636, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:16.652320 10577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:16.627383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:51243 (local address 127.10.20.126:46105)
0808 02:37:16.627937 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:16.627943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:16.629171 (+ 1228us) server_negotiation.cc:407] Connection header received
0808 02:37:16.631429 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:16.631439 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:16.631559 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:16.631702 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:16.633680 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:16.635095 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:16.637139 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:16.637980 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:16.638156 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:16.643830 (+ 5674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:16.643837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:16.643842 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:16.643887 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:16.647489 (+ 3602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:16.648939 (+ 1450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:16.648945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:16.648948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:16.649160 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:16.649873 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:16.649878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:16.649881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:16.650242 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:16.650388 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:16.651708 (+ 1320us) server_negotiation.cc:299] Negotiation successful
0808 02:37:16.652021 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":293,"threads_started":1}
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:37:16.653685 10579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:16.628133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46105 (local address 127.10.20.65:51243)
0808 02:37:16.628970 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:16.629023 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:16.631084 (+ 2061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:16.632064 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:16.632074 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:16.632698 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:16.633373 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:16.633394 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:16.635375 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:16.635379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:16.636923 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:16.636940 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:16.638352 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:16.638361 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:16.638852 (+ 491us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:16.639813 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:16.639852 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:16.643428 (+ 3576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:16.647805 (+ 4377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:16.647822 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:16.647851 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:16.648745 (+ 894us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:16.649320 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:16.649329 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:16.649337 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:16.649698 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:16.650429 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:16.650441 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:16.651062 (+ 621us) client_negotiation.cc:769] Sending connection context
0808 02:37:16.651545 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 02:37:16.652274 (+ 729us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":989,"threads_started":1}
I20260808 02:37:16.655918 10574 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46105
I20260808 02:37:16.656402 10574 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
I20260808 02:37:16.657577 10574 heartbeater.cc:511] Master 127.10.20.126:46105 requested a full tablet report, sending...
I20260808 02:37:16.661840 10374 ts_manager.cc:194] Registered new tserver with Master: d7269ed34b0c4e5d936dcd7388cf23b2 (127.10.20.65:39765)
I20260808 02:37:16.664137 10374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:51243
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:16.692137 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46105
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:17.070819 10582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:17.071177 10582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:17.071353 10582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:17.079809 10582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:17.080116 10582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:17.080459 10582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:17.092964 10582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46105
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:17.094476 10582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:17.096019 10582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:17.111338 10587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:17.111357 10590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:17.111595 10588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:17.112291 10582 server_base.cc:1034] running on GCE node
I20260808 02:37:17.112968 10582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:17.114108 10582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:17.115393 10582 hybrid_clock.cc:648] HybridClock initialized: now 1786156637115342 us; error 78 us; skew 500 ppm
I20260808 02:37:17.115820 10582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:17.119997 10582 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:17.122008 10582 webserver.cc:460] Webserver started at http://127.10.20.66:42677/ using document root <none> and password file <none>
I20260808 02:37:17.122961 10582 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:17.123190 10582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:17.123564 10582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:17.127425 10582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "d9e61ddaa578437487e2ec99b688ba99"
format_stamp: "Formatted at 2026-08-08 02:37:17 on dist-test-slave-8tdl"
server_key: "7350b338eb0a675d635f14caf92fa64b"
server_key_iv: "9a60049780e9e448b43a327fc379dece"
server_key_version: "encryptionkey@0"
I20260808 02:37:17.128408 10582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "d9e61ddaa578437487e2ec99b688ba99"
format_stamp: "Formatted at 2026-08-08 02:37:17 on dist-test-slave-8tdl"
server_key: "7350b338eb0a675d635f14caf92fa64b"
server_key_iv: "9a60049780e9e448b43a327fc379dece"
server_key_version: "encryptionkey@0"
I20260808 02:37:17.134838 10582 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:37:17.140473 10598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:17.142470 10582 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:37:17.142807 10582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "d9e61ddaa578437487e2ec99b688ba99"
format_stamp: "Formatted at 2026-08-08 02:37:17 on dist-test-slave-8tdl"
server_key: "7350b338eb0a675d635f14caf92fa64b"
server_key_iv: "9a60049780e9e448b43a327fc379dece"
server_key_version: "encryptionkey@0"
I20260808 02:37:17.143136 10582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:17.174122 10582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:17.179530 10582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:17.179888 10582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:17.181140 10582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:17.182868 10582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:17.183000 10582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:17.183167 10582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:17.183248 10582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:17.225566 10582 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:34547
I20260808 02:37:17.225672 10718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:34547 every 8 connection(s)
I20260808 02:37:17.227032 10582 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:17.229943 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 10582
I20260808 02:37:17.230214 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:17.230871 10321 external_mini_cluster.cc:1428] Setting key 597a9912c1204d7749753ee0d3058c61
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:17.253485 10721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:17.229953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:46595 (local address 127.10.20.126:46105)
0808 02:37:17.230535 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:17.230542 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:17.231839 (+ 1297us) server_negotiation.cc:407] Connection header received
0808 02:37:17.233842 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:17.233851 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:17.233954 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:17.234087 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:17.235958 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.237459 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.239714 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.240535 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.240722 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:17.245662 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:17.245669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:17.245673 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:17.245717 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:17.249730 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:17.250813 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:17.250820 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:17.250824 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:17.250979 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:17.251489 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:17.251494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:17.251497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:17.251827 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:17.252004 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:17.252819 (+ 815us) server_negotiation.cc:299] Negotiation successful
0808 02:37:17.253083 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":289,"threads_started":1}
I20260808 02:37:17.254602 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:17.230589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46105 (local address 127.10.20.66:46595)
0808 02:37:17.231657 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:17.231713 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:17.233519 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:17.234336 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:17.234345 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:17.235104 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:17.235733 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:17.235753 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.237706 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.237711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:17.239521 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:17.239537 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.240904 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.240912 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:17.241145 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:17.241968 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:17.242001 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:17.245303 (+ 3302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:17.249911 (+ 4608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:17.249935 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:17.249952 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:17.250606 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:17.251112 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:17.251120 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:17.251129 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:17.251340 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:17.251982 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:17.251990 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:17.252406 (+ 416us) client_negotiation.cc:769] Sending connection context
0808 02:37:17.252713 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 02:37:17.253364 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":468,"threads_started":1}
I20260808 02:37:17.256614 10719 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46105
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
I20260808 02:37:17.257113 10719 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:17.258051 10719 heartbeater.cc:511] Master 127.10.20.126:46105 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
I20260808 02:37:17.260404 10374 ts_manager.cc:194] Registered new tserver with Master: d9e61ddaa578437487e2ec99b688ba99 (127.10.20.66:34547)
I20260808 02:37:17.261359 10374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:46595
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:17.291575 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46105
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:17.668674 10574 heartbeater.cc:503] Master 127.10.20.126:46105 was elected leader, sending a full tablet report...
W20260808 02:37:17.669929 10725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:17.670426 10725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:17.670600 10725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:17.679721 10725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:17.679896 10725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:17.680033 10725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:17.691036 10725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46105
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:17.692500 10725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:17.694013 10725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:17.709617 10733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:17.709991 10731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:17.710280 10730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:17.710816 10725 server_base.cc:1034] running on GCE node
I20260808 02:37:17.711514 10725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:17.712708 10725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:17.713981 10725 hybrid_clock.cc:648] HybridClock initialized: now 1786156637713931 us; error 41 us; skew 500 ppm
I20260808 02:37:17.714425 10725 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:17.718333 10725 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:17.720292 10725 webserver.cc:460] Webserver started at http://127.10.20.67:40203/ using document root <none> and password file <none>
I20260808 02:37:17.721446 10725 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:17.721652 10725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:17.722273 10725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:17.727610 10725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "a589413e8c5644519870508ae8a273ad"
format_stamp: "Formatted at 2026-08-08 02:37:17 on dist-test-slave-8tdl"
server_key: "4d91de4c054b1947867edc0dccee8943"
server_key_iv: "db1fcd26c1c1a51c4c7ba756d1bdfde7"
server_key_version: "encryptionkey@0"
I20260808 02:37:17.728828 10725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "a589413e8c5644519870508ae8a273ad"
format_stamp: "Formatted at 2026-08-08 02:37:17 on dist-test-slave-8tdl"
server_key: "4d91de4c054b1947867edc0dccee8943"
server_key_iv: "db1fcd26c1c1a51c4c7ba756d1bdfde7"
server_key_version: "encryptionkey@0"
I20260808 02:37:17.736629 10725 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260808 02:37:17.741487 10740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:17.743382 10725 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260808 02:37:17.743628 10725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "a589413e8c5644519870508ae8a273ad"
format_stamp: "Formatted at 2026-08-08 02:37:17 on dist-test-slave-8tdl"
server_key: "4d91de4c054b1947867edc0dccee8943"
server_key_iv: "db1fcd26c1c1a51c4c7ba756d1bdfde7"
server_key_version: "encryptionkey@0"
I20260808 02:37:17.743968 10725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:17.782352 10725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:17.787631 10725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:17.788003 10725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:17.789156 10725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:17.790819 10725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:17.790936 10725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:17.791109 10725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:17.791190 10725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:17.830658 10725 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:40901
I20260808 02:37:17.830726 10861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:40901 every 8 connection(s)
I20260808 02:37:17.832182 10725 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:17.841042 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 10725
I20260808 02:37:17.841277 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:17.841785 10321 external_mini_cluster.cc:1428] Setting key 67bbf4662f61336dac54f627e6c4a369
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:17.860931 10864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:17.835425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:38893 (local address 127.10.20.126:46105)
0808 02:37:17.836055 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:17.836062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:17.837259 (+ 1197us) server_negotiation.cc:407] Connection header received
0808 02:37:17.839655 (+ 2396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:17.839661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:17.839785 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:17.840168 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:17.842600 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.843769 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.846650 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.847280 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.847461 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:17.852751 (+ 5290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:17.852758 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:17.852761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:17.852814 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:17.856129 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:17.857235 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:17.857242 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:17.857244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:17.857414 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:17.858083 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:17.858090 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:17.858093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:17.858533 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:17.858738 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:17.859996 (+ 1258us) server_negotiation.cc:299] Negotiation successful
0808 02:37:17.860320 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":263,"threads_started":1}
I20260808 02:37:17.861968 10865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:17.836060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46105 (local address 127.10.20.67:38893)
0808 02:37:17.837030 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:17.837083 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:17.839226 (+ 2143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:17.840521 (+ 1295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:17.840533 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:17.841496 (+ 963us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:17.842285 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:17.842309 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.843989 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.843996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:17.846424 (+ 2428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:17.846457 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.847634 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.847641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:17.847888 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:17.848908 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:17.849093 (+ 185us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:17.852430 (+ 3337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:17.856371 (+ 3941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:17.856381 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:17.856401 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:17.857049 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:17.857594 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:17.857598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:17.857600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:17.857911 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:17.858767 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:17.858776 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:17.859385 (+ 609us) client_negotiation.cc:769] Sending connection context
0808 02:37:17.859807 (+ 422us) client_negotiation.cc:240] Negotiation successful
0808 02:37:17.860398 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":353,"threads_started":1}
I20260808 02:37:17.863713 10862 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46105
I20260808 02:37:17.864107 10862 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:17.864980 10862 heartbeater.cc:511] Master 127.10.20.126:46105 requested a full tablet report, sending...
I20260808 02:37:17.866918 10374 ts_manager.cc:194] Registered new tserver with Master: a589413e8c5644519870508ae8a273ad (127.10.20.67:40901)
I20260808 02:37:17.867888 10374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:38893
I20260808 02:37:17.874331 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:17.939459 10869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:17.919247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41882 (local address 127.10.20.65:39765)
0808 02:37:17.920058 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:17.920065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:17.920316 (+ 251us) server_negotiation.cc:407] Connection header received
0808 02:37:17.920760 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:17.920768 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:17.921034 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:17.921180 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:17.923325 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.924473 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.926231 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.927011 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.927138 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:17.932104 (+ 4966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:17.932135 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:17.932158 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:17.932216 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:17.935682 (+ 3466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:17.936665 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:17.936673 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:17.936675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:17.936824 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:17.937614 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:17.937618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:17.937620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:17.938100 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:17.938361 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:17.938857 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 02:37:17.939124 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":413,"threads_started":1}
W20260808 02:37:17.941033 10484 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41882
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:37:17 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:18.006764 10869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:17.989593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41890 (local address 127.10.20.65:39765)
0808 02:37:17.989872 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:17.989880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:17.990179 (+ 299us) server_negotiation.cc:407] Connection header received
0808 02:37:17.990422 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:17.990427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:17.990534 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:17.990657 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:17.992426 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.993258 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.994673 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:17.995204 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:17.995312 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:18.000033 (+ 4721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:18.000041 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:18.000131 (+ 90us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:18.000193 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:18.003320 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.004196 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.004202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.004205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.004392 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.004892 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.004897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.004899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.005230 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:18.005602 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:18.006159 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 02:37:18.006370 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 02:37:18.008957 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 10440
I20260808 02:37:18.025812 10869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:18.010372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.10.20.65:39765)
0808 02:37:18.010646 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:18.010653 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:18.010860 (+ 207us) server_negotiation.cc:407] Connection header received
0808 02:37:18.011145 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:18.011150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:18.011217 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:18.011327 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:18.012662 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:18.013534 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:18.015212 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:18.015685 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:18.015846 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:18.019057 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:18.019063 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:18.019066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:18.019111 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:18.022523 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.023541 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.023553 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.023556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.023721 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.024193 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.024204 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.024207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.024496 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:18.024764 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:18.025143 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 02:37:18.025393 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260808 02:37:18.026916 10568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:18.136142 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 10440
I20260808 02:37:18.159351 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 10582
Aug 08 02:37:18 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:37:18.187668 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:18.160766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60508 (local address 127.10.20.66:34547)
0808 02:37:18.161682 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:18.161689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:18.161743 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:37:18.161931 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:18.161941 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:18.162188 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:18.162467 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:18.165060 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:18.167587 (+ 2527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:18.169508 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:18.170241 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:18.170393 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:18.178034 (+ 7641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:18.178053 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:18.178071 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:18.178128 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:18.182443 (+ 4315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.183619 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.183630 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.183633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.183849 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.185131 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.185136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.185139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.185634 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:18.185919 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:18.186550 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 02:37:18.187186 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":597,"threads_started":1}
I20260808 02:37:18.189518 10714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:18.278342 10719 heartbeater.cc:503] Master 127.10.20.126:46105 was elected leader, sending a full tablet report...
I20260808 02:37:18.279678 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 10582
W20260808 02:37:18.301433 10360 connection.cc:535] server connection from 127.10.20.66:46595 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:37:18.301609 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 10725
Aug 08 02:37:18 dist-test-slave-8tdl krb5kdc[10328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:37:18.321336 10882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:18.302777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54024 (local address 127.10.20.67:40901)
0808 02:37:18.303326 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:18.303334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:18.303365 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:37:18.303438 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:18.303445 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:18.303671 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:18.303875 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:18.305291 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:18.306345 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:18.307884 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:18.308495 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:18.308662 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:18.314016 (+ 5354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:18.314032 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:18.314049 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:18.314095 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:18.317791 (+ 3696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.318784 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.318792 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.318794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.318954 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:18.319416 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:18.319420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:18.319423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:18.319839 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:18.320208 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:18.320576 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 02:37:18.320898 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":242,"threads_started":1}
I20260808 02:37:18.322909 10857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:18.411854 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 10725
I20260808 02:37:18.432477 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 10341
I20260808 02:37:18.434049 10405 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:18.546968 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 10341
2026-08-08T02:37:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4895 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:18 dist-test-slave-8tdl krb5kdc[10887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:18 dist-test-slave-8tdl krb5kdc[10887](info): set up 2 sockets
Aug 08 02:37:18 dist-test-slave-8tdl krb5kdc[10887](info): commencing operation
krb5kdc: starting...
W20260808 02:37:19.718539 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:19 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:19.984283 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35389
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:35389
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:20.353464 10901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:20.353825 10901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:20.354019 10901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:20.362499 10901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:20.362655 10901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:20.362793 10901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:20.362926 10901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:20.362995 10901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:20.374361 10901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:35389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:20.376077 10901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:20.377614 10901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:20.391644 10907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:20.391688 10908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:20.391746 10910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:20.397137 10901 server_base.cc:1034] running on GCE node
I20260808 02:37:20.398144 10901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:20.400110 10901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:20.401418 10901 hybrid_clock.cc:648] HybridClock initialized: now 1786156640401378 us; error 66 us; skew 500 ppm
I20260808 02:37:20.401885 10901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:20 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156640, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:20.414002 10901 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:20.416241 10901 webserver.cc:460] Webserver started at http://127.10.20.126:43981/ using document root <none> and password file <none>
I20260808 02:37:20.417112 10901 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:20.417289 10901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:20.417666 10901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:20.421646 10901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "f91f182ef3c147299e57a897dc0e5342"
format_stamp: "Formatted at 2026-08-08 02:37:20 on dist-test-slave-8tdl"
server_key: "bdfe9eef86dedc8dd74084a0874507ed"
server_key_iv: "79172f8e8dff53593d4576350508d34e"
server_key_version: "encryptionkey@0"
I20260808 02:37:20.422640 10901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "f91f182ef3c147299e57a897dc0e5342"
format_stamp: "Formatted at 2026-08-08 02:37:20 on dist-test-slave-8tdl"
server_key: "bdfe9eef86dedc8dd74084a0874507ed"
server_key_iv: "79172f8e8dff53593d4576350508d34e"
server_key_version: "encryptionkey@0"
I20260808 02:37:20.429730 10901 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:37:20.434367 10917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:20.436353 10901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 02:37:20.436638 10901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "f91f182ef3c147299e57a897dc0e5342"
format_stamp: "Formatted at 2026-08-08 02:37:20 on dist-test-slave-8tdl"
server_key: "bdfe9eef86dedc8dd74084a0874507ed"
server_key_iv: "79172f8e8dff53593d4576350508d34e"
server_key_version: "encryptionkey@0"
I20260808 02:37:20.436926 10901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:20.460501 10901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:20.465662 10901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:20.466099 10901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:20.488878 10901 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:35389
I20260808 02:37:20.488914 10971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:35389 every 8 connection(s)
I20260808 02:37:20.490535 10901 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:20.492247 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 10901
I20260808 02:37:20.492560 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:20.493400 10321 external_mini_cluster.cc:1428] Setting key 97d4b4c5acf4f6a7fd6aae8aad6f2dc7
I20260808 02:37:20.496686 10972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:37:20 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:20.511060 10972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342: Bootstrap starting.
I20260808 02:37:20.515569 10972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:20.516836 10972 log.cc:824] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:20.520315 10972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342: No bootstrap required, opened a new log
I20260808 02:37:20.521450 10975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:20.495869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37344 (local address 127.10.20.126:35389)
0808 02:37:20.496769 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:20.496787 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:20.496844 (+ 57us) server_negotiation.cc:407] Connection header received
0808 02:37:20.499336 (+ 2492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:20.499367 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:20.499920 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:20.500452 (+ 532us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:20.502115 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:20.504323 (+ 2208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:20.505851 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:20.506996 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:20.507197 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:20.511973 (+ 4776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:20.511986 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:20.512007 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:20.512062 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:20.516393 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:20.517368 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:20.517376 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:20.517383 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:20.517613 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:20.518108 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:20.518113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:20.518122 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:20.518815 (+ 693us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:20.519170 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:20.519748 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 02:37:20.520251 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":364,"threads_started":1}
I20260808 02:37:20.529970 10972 raft_consensus.cc:348] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91f182ef3c147299e57a897dc0e5342" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35389 } }
I20260808 02:37:20.530536 10972 raft_consensus.cc:374] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:20.530718 10972 raft_consensus.cc:729] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91f182ef3c147299e57a897dc0e5342, State: Initialized, Role: FOLLOWER
I20260808 02:37:20.531371 10972 consensus_queue.cc:260] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91f182ef3c147299e57a897dc0e5342" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35389 } }
I20260808 02:37:20.531627 10972 raft_consensus.cc:388] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:20.531738 10972 raft_consensus.cc:482] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:20.531879 10972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:20.534740 10972 raft_consensus.cc:504] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91f182ef3c147299e57a897dc0e5342" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35389 } }
I20260808 02:37:20.535526 10972 leader_election.cc:302] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f91f182ef3c147299e57a897dc0e5342; no voters:
I20260808 02:37:20.536366 10972 leader_election.cc:288] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:20.536444 10978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:20.537622 10978 raft_consensus.cc:686] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [term 1 LEADER]: Becoming Leader. State: Replica: f91f182ef3c147299e57a897dc0e5342, State: Running, Role: LEADER
I20260808 02:37:20.538381 10978 consensus_queue.cc:237] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91f182ef3c147299e57a897dc0e5342" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35389 } }
I20260808 02:37:20.539363 10972 sys_catalog.cc:564] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:20.541879 10981 sys_catalog.cc:455] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f91f182ef3c147299e57a897dc0e5342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91f182ef3c147299e57a897dc0e5342" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35389 } } }
I20260808 02:37:20.541965 10980 sys_catalog.cc:455] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f91f182ef3c147299e57a897dc0e5342. Latest consensus state: current_term: 1 leader_uuid: "f91f182ef3c147299e57a897dc0e5342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91f182ef3c147299e57a897dc0e5342" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35389 } } }
I20260808 02:37:20.542399 10981 sys_catalog.cc:458] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:20.542435 10980 sys_catalog.cc:458] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:20.547441 10985 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:20.553325 10985 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:20.564464 10985 catalog_manager.cc:1347] Generated new cluster ID: 5e8a76cbdec94fdb84cacc88512d9078
I20260808 02:37:20.564657 10985 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:20.589198 10985 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:20.591499 10985 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:20.606513 10985 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f91f182ef3c147299e57a897dc0e5342: Generated new TSK 0
I20260808 02:37:20.607522 10985 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:20.682461 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35389
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:21.053328 11001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:21.053743 11001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:21.054060 11001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:21.062206 11001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:21.062426 11001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:21.062633 11001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:21.073338 11001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35389
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:21.075245 11001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:21.076846 11001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:21.092136 11010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:21.092145 11008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:21.092504 11007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:21.092671 11001 server_base.cc:1034] running on GCE node
I20260808 02:37:21.093729 11001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:21.095110 11001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:21.096433 11001 hybrid_clock.cc:648] HybridClock initialized: now 1786156641096372 us; error 58 us; skew 500 ppm
I20260808 02:37:21.096853 11001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:21 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156641, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:21.100955 11001 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:21.103015 11001 webserver.cc:460] Webserver started at http://127.10.20.65:33603/ using document root <none> and password file <none>
I20260808 02:37:21.103883 11001 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:21.104012 11001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:21.104319 11001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:21.108264 11001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "eb6ddb29bf4f41fa88dd6c83a310200f"
format_stamp: "Formatted at 2026-08-08 02:37:21 on dist-test-slave-8tdl"
server_key: "65efbc1f2d73941432d2020a82ddc3d0"
server_key_iv: "36b9bf806e0cf97b19b31daf6abc28ef"
server_key_version: "encryptionkey@0"
I20260808 02:37:21.109388 11001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "eb6ddb29bf4f41fa88dd6c83a310200f"
format_stamp: "Formatted at 2026-08-08 02:37:21 on dist-test-slave-8tdl"
server_key: "65efbc1f2d73941432d2020a82ddc3d0"
server_key_iv: "36b9bf806e0cf97b19b31daf6abc28ef"
server_key_version: "encryptionkey@0"
I20260808 02:37:21.116063 11001 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 02:37:21.120576 11018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:21.122655 11001 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:21.122951 11001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "eb6ddb29bf4f41fa88dd6c83a310200f"
format_stamp: "Formatted at 2026-08-08 02:37:21 on dist-test-slave-8tdl"
server_key: "65efbc1f2d73941432d2020a82ddc3d0"
server_key_iv: "36b9bf806e0cf97b19b31daf6abc28ef"
server_key_version: "encryptionkey@0"
I20260808 02:37:21.123185 11001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:21.144595 11001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:21.150874 11001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:21.151417 11001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:21.152791 11001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:21.154561 11001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:21.154662 11001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:21.154893 11001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:21.154938 11001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:21.194630 11001 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:34989
I20260808 02:37:21.194784 11137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:34989 every 8 connection(s)
I20260808 02:37:21.196189 11001 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:21.200868 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11001
I20260808 02:37:21.201138 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:21.202077 10321 external_mini_cluster.cc:1428] Setting key 4fc596350759be3e18f82820a8f7e9fa
Aug 08 02:37:21 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156641, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:21.224177 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:21.199274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:56997 (local address 127.10.20.126:35389)
0808 02:37:21.199816 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:21.199821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:21.201152 (+ 1331us) server_negotiation.cc:407] Connection header received
0808 02:37:21.203736 (+ 2584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:21.203741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:21.203819 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:21.203936 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:21.206277 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.207174 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.209949 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.210386 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.210504 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:21.216235 (+ 5731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:21.216243 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:21.216247 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:21.216293 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:21.219558 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:21.220695 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:21.220705 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:21.220711 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:21.220913 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:21.221558 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:21.221566 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:21.221572 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:21.222068 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:21.222287 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:21.223336 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0808 02:37:21.223650 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":284,"threads_started":1}
I20260808 02:37:21.224879 11141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:21.199918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35389 (local address 127.10.20.65:56997)
0808 02:37:21.200931 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:21.200997 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:21.203429 (+ 2432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:21.204205 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:21.204215 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:21.205114 (+ 899us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:21.206033 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:21.206065 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.207375 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.207392 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:21.209734 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:21.209756 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.210670 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.210716 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:21.211072 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:21.212085 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:21.212123 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:21.215884 (+ 3761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:21.219782 (+ 3898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:21.219794 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:21.219817 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:21.220485 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:21.221091 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:21.221095 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:21.221098 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:21.221390 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:21.222290 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:21.222298 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:21.222821 (+ 523us) client_negotiation.cc:769] Sending connection context
0808 02:37:21.223167 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 02:37:21.223625 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":445,"threads_started":1}
I20260808 02:37:21.226734 11138 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35389
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:37:21.227137 11138 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:21.228051 11138 heartbeater.cc:511] Master 127.10.20.126:35389 requested a full tablet report, sending...
I20260808 02:37:21.230772 10934 ts_manager.cc:194] Registered new tserver with Master: eb6ddb29bf4f41fa88dd6c83a310200f (127.10.20.65:34989)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
I20260808 02:37:21.232488 10934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:56997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:21.263572 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35389
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:21.630662 11144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:21.631108 11144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:21.631219 11144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:21.639160 11144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:21.639336 11144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:21.639549 11144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:21.650432 11144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35389
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:21.652012 11144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:21.653477 11144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:21.669302 11150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:21.669282 11151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:21.669229 11153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:21.670666 11144 server_base.cc:1034] running on GCE node
I20260808 02:37:21.671625 11144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:21.672926 11144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:21.674222 11144 hybrid_clock.cc:648] HybridClock initialized: now 1786156641674178 us; error 54 us; skew 500 ppm
I20260808 02:37:21.674741 11144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:21 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156641, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:21.678969 11144 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:21.681046 11144 webserver.cc:460] Webserver started at http://127.10.20.66:34075/ using document root <none> and password file <none>
I20260808 02:37:21.681880 11144 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:21.682067 11144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:21.682428 11144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:21.685882 11144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "f4215a5064d04898acf016bf2316ee58"
format_stamp: "Formatted at 2026-08-08 02:37:21 on dist-test-slave-8tdl"
server_key: "f7a0b63eaa1eb2a080c3d68a4a3edbce"
server_key_iv: "4a0b6496cc4ed17fdce125dae29ddc19"
server_key_version: "encryptionkey@0"
I20260808 02:37:21.687037 11144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "f4215a5064d04898acf016bf2316ee58"
format_stamp: "Formatted at 2026-08-08 02:37:21 on dist-test-slave-8tdl"
server_key: "f7a0b63eaa1eb2a080c3d68a4a3edbce"
server_key_iv: "4a0b6496cc4ed17fdce125dae29ddc19"
server_key_version: "encryptionkey@0"
I20260808 02:37:21.692909 11144 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:37:21.696961 11160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:21.698839 11144 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:21.699051 11144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "f4215a5064d04898acf016bf2316ee58"
format_stamp: "Formatted at 2026-08-08 02:37:21 on dist-test-slave-8tdl"
server_key: "f7a0b63eaa1eb2a080c3d68a4a3edbce"
server_key_iv: "4a0b6496cc4ed17fdce125dae29ddc19"
server_key_version: "encryptionkey@0"
I20260808 02:37:21.699287 11144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:21.724011 11144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:21.731632 11144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:21.732023 11144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:21.733304 11144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:21.734993 11144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:21.735167 11144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:21.735329 11144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:21.735409 11144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:21.777590 11144 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:44803
I20260808 02:37:21.777695 11279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:44803 every 8 connection(s)
I20260808 02:37:21.779152 11144 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:21.781394 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11144
I20260808 02:37:21.781615 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:21.782126 10321 external_mini_cluster.cc:1428] Setting key dd8a9c148034988aaae9fca06014f1e4
Aug 08 02:37:21 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156641, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:21.806273 11282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:21.782425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:39985 (local address 127.10.20.126:35389)
0808 02:37:21.783023 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:21.783030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:21.784459 (+ 1429us) server_negotiation.cc:407] Connection header received
0808 02:37:21.786745 (+ 2286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:21.786754 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:21.786871 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:21.787015 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:21.789214 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.790432 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.792532 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.793335 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.793468 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:21.798555 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:21.798562 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:21.798572 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:21.798613 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:21.801680 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:21.803119 (+ 1439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:21.803124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:21.803126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:21.803280 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:21.804058 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:21.804063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:21.804066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:21.804429 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:21.804640 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:21.805772 (+ 1132us) server_negotiation.cc:299] Negotiation successful
0808 02:37:21.805995 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":294,"threads_started":1}
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
I20260808 02:37:21.807993 11283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:21.783199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35389 (local address 127.10.20.66:39985)
0808 02:37:21.784158 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:21.784210 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:21.786252 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:21.787397 (+ 1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:21.787408 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:21.788044 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:21.788936 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:21.788976 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.790763 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.790769 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:21.792323 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:21.792341 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:21.793665 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:21.793676 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:21.794085 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:21.795128 (+ 1043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:21.795167 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:21.798065 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:21.801908 (+ 3843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:21.801923 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:21.801949 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:21.802886 (+ 937us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:21.803441 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:21.803449 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:21.803454 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:21.803793 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:21.804637 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:21.804650 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:21.805236 (+ 586us) client_negotiation.cc:769] Sending connection context
0808 02:37:21.805617 (+ 381us) client_negotiation.cc:240] Negotiation successful
0808 02:37:21.806290 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":383,"threads_started":1}
I20260808 02:37:21.809799 11280 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35389
I20260808 02:37:21.810181 11280 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:21.811098 11280 heartbeater.cc:511] Master 127.10.20.126:35389 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
I20260808 02:37:21.812914 10934 ts_manager.cc:194] Registered new tserver with Master: f4215a5064d04898acf016bf2316ee58 (127.10.20.66:44803)
I20260808 02:37:21.813833 10934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:39985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:21.845160 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35389
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:22.222374 11286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:22.222772 11286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:22.222905 11286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:22.231637 11286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:22.231786 11286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:22.231931 11286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:22.236191 11138 heartbeater.cc:503] Master 127.10.20.126:35389 was elected leader, sending a full tablet report...
I20260808 02:37:22.244983 11286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35389
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:22.246567 11286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:22.248234 11286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:22.264674 11291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:22.264827 11294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:22.264693 11292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:22.265882 11286 server_base.cc:1034] running on GCE node
I20260808 02:37:22.266629 11286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:22.267833 11286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:22.269134 11286 hybrid_clock.cc:648] HybridClock initialized: now 1786156642269082 us; error 49 us; skew 500 ppm
I20260808 02:37:22.269522 11286 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:22.273228 11286 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:22.275197 11286 webserver.cc:460] Webserver started at http://127.10.20.67:37171/ using document root <none> and password file <none>
I20260808 02:37:22.276018 11286 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:22.276144 11286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:22.276543 11286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:22.280486 11286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "9b32735c285247ea86968c8a012a8441"
format_stamp: "Formatted at 2026-08-08 02:37:22 on dist-test-slave-8tdl"
server_key: "80f7bab7e801bb7d950f489c46cd4738"
server_key_iv: "5bfd1dad19e29a2ec87364334a188600"
server_key_version: "encryptionkey@0"
I20260808 02:37:22.281570 11286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "9b32735c285247ea86968c8a012a8441"
format_stamp: "Formatted at 2026-08-08 02:37:22 on dist-test-slave-8tdl"
server_key: "80f7bab7e801bb7d950f489c46cd4738"
server_key_iv: "5bfd1dad19e29a2ec87364334a188600"
server_key_version: "encryptionkey@0"
I20260808 02:37:22.287776 11286 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 02:37:22.292404 11301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:22.294169 11286 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260808 02:37:22.294456 11286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9b32735c285247ea86968c8a012a8441"
format_stamp: "Formatted at 2026-08-08 02:37:22 on dist-test-slave-8tdl"
server_key: "80f7bab7e801bb7d950f489c46cd4738"
server_key_iv: "5bfd1dad19e29a2ec87364334a188600"
server_key_version: "encryptionkey@0"
I20260808 02:37:22.294763 11286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:22.332801 11286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:22.337839 11286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:22.338182 11286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:22.339326 11286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:22.341131 11286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:22.341234 11286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:22.341395 11286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:22.341468 11286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:22.378377 11286 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:37519
I20260808 02:37:22.378482 11423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:37519 every 8 connection(s)
I20260808 02:37:22.379845 11286 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:22.384225 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11286
I20260808 02:37:22.384461 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:22.385070 10321 external_mini_cluster.cc:1428] Setting key aadd909dc22b9157bf2562b66ce76d12
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:22.405436 11426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.383234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:50567 (local address 127.10.20.126:35389)
0808 02:37:22.383797 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.383806 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.384807 (+ 1001us) server_negotiation.cc:407] Connection header received
0808 02:37:22.387110 (+ 2303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.387114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.387231 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.387413 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.389441 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.390271 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.392190 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.392653 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.392766 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.397251 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.397258 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.397261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.397320 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.401300 (+ 3980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.402548 (+ 1248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.402553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.402555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.402821 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.403337 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.403341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.403343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.403852 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.403997 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.404858 (+ 861us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.405102 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":290,"threads_started":1}
I20260808 02:37:22.406761 11429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.383693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35389 (local address 127.10.20.67:50567)
0808 02:37:22.384594 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:22.384658 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:22.386755 (+ 2097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:22.387743 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:22.387753 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:22.388421 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:22.389240 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.389261 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.390478 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.390482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.392005 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.392020 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.392915 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.392921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.393155 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.394075 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:22.394101 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:22.396928 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:22.401547 (+ 4619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:22.401560 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:22.401583 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:22.402371 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:22.402955 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:22.402960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:22.402963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:22.403188 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:22.404006 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:22.404014 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:22.404437 (+ 423us) client_negotiation.cc:769] Sending connection context
0808 02:37:22.404702 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 02:37:22.405191 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":337,"threads_started":1}
I20260808 02:37:22.408629 11424 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35389
I20260808 02:37:22.409013 11424 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:22.409874 11424 heartbeater.cc:511] Master 127.10.20.126:35389 requested a full tablet report, sending...
I20260808 02:37:22.411639 10934 ts_manager.cc:194] Registered new tserver with Master: 9b32735c285247ea86968c8a012a8441 (127.10.20.67:37519)
I20260808 02:37:22.412748 10934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:50567
I20260808 02:37:22.415417 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:37:22.440991 11426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.424162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37352 (local address 127.10.20.126:35389)
0808 02:37:22.424421 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.424429 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.424981 (+ 552us) server_negotiation.cc:407] Connection header received
0808 02:37:22.425114 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.425119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.425198 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.425303 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.427702 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.428587 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.430213 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.430776 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.430905 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.433924 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.433931 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.433934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.433978 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.437096 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.438076 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.438082 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.438085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.438241 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.439048 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.439054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.439057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.439470 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.439792 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.440385 (+ 593us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.440633 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 02:37:22.455286 10934 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:22.467206 10934 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:22.527992 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.491398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37519 (local address 127.0.0.1:50212)
0808 02:37:22.503451 (+ 12053us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:22.503513 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:22.503857 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:22.516646 (+ 12789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:22.516657 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:22.516711 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:22.517229 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.517254 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.520416 (+ 3162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.520425 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.524065 (+ 3640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.524090 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.526591 (+ 2501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.526599 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.526969 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.527042 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 02:37:22.527197 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 02:37:22.527429 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11735,"mutex_wait_us":24,"thread_start_us":31437,"threads_started":1}
I20260808 02:37:22.527995 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.491594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50212 (local address 127.10.20.67:37519)
0808 02:37:22.515557 (+ 23963us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.515572 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.515633 (+ 61us) server_negotiation.cc:407] Connection header received
0808 02:37:22.515789 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.515802 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.516205 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.517516 (+ 1311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:22.518084 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.520225 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.524512 (+ 4287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.526293 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.526992 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.527285 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.527368 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.527548 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23650,"thread_start_us":23411,"threads_started":1}
I20260808 02:37:22.529843 11444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.491861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:44803 (local address 127.0.0.1:40776)
0808 02:37:22.517985 (+ 26124us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:22.518011 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:22.518157 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:22.519566 (+ 1409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:22.519572 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:22.519605 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:22.520114 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.520130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.522586 (+ 2456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.522596 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.526590 (+ 3994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.526607 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.528935 (+ 2328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.528945 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.529145 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.529184 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:37:22.529288 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:37:22.529443 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25882,"thread_start_us":10959,"threads_started":1}
I20260808 02:37:22.531116 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.492543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.10.20.66:44803)
0808 02:37:22.517141 (+ 24598us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.517153 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.518329 (+ 1176us) server_negotiation.cc:407] Connection header received
0808 02:37:22.518451 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.518461 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.518823 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.519045 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:22.520374 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.522133 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.526900 (+ 4767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.528577 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.528741 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.528963 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.530395 (+ 1432us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.530761 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24401,"thread_start_us":24799,"threads_started":1}
I20260808 02:37:22.535331 11353 tablet_service.cc:1467] Processing CreateTablet for tablet c6c7a755a0354052ac22010065b4fe0b (DEFAULT_TABLE table=test-table [id=2d46f14ca2c54eaea53b8b8449a3b545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:22.535331 11209 tablet_service.cc:1467] Processing CreateTablet for tablet c6c7a755a0354052ac22010065b4fe0b (DEFAULT_TABLE table=test-table [id=2d46f14ca2c54eaea53b8b8449a3b545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:22.537449 11209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c7a755a0354052ac22010065b4fe0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:22.537432 11353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c7a755a0354052ac22010065b4fe0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:22.538142 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.505970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34989 (local address 127.0.0.1:40074)
0808 02:37:22.525215 (+ 19245us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:22.525241 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:22.525411 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:22.526615 (+ 1204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:22.526619 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:22.526648 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:22.528401 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.528418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.533190 (+ 4772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.533197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.535168 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.535189 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.537141 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.537148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.537344 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.537385 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 02:37:22.537514 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 02:37:22.537689 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17874,"mutex_wait_us":6,"thread_start_us":16365,"threads_started":1}
I20260808 02:37:22.538473 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.506484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40074 (local address 127.10.20.65:34989)
0808 02:37:22.520874 (+ 14390us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.520888 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.525594 (+ 4706us) server_negotiation.cc:407] Connection header received
0808 02:37:22.525730 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.525740 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.526065 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.526311 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:22.528652 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.532774 (+ 4122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.535420 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.536861 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.537057 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.537317 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.537776 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.537975 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14119,"thread_start_us":14401,"threads_started":1}
I20260808 02:37:22.542544 11069 tablet_service.cc:1467] Processing CreateTablet for tablet c6c7a755a0354052ac22010065b4fe0b (DEFAULT_TABLE table=test-table [id=2d46f14ca2c54eaea53b8b8449a3b545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:22.544370 11069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c7a755a0354052ac22010065b4fe0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:22.557009 11446 tablet_bootstrap.cc:492] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: Bootstrap starting.
I20260808 02:37:22.559880 11448 tablet_bootstrap.cc:492] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: Bootstrap starting.
I20260808 02:37:22.561766 11447 tablet_bootstrap.cc:492] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: Bootstrap starting.
I20260808 02:37:22.562229 11446 tablet_bootstrap.cc:654] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:22.563925 11448 tablet_bootstrap.cc:654] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:22.563966 11446 log.cc:824] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:22.565227 11448 log.cc:824] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:22.565934 11447 tablet_bootstrap.cc:654] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:22.567699 11447 log.cc:824] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:22.568396 11446 tablet_bootstrap.cc:492] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: No bootstrap required, opened a new log
I20260808 02:37:22.568745 11446 ts_tablet_manager.cc:1397] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 02:37:22.568994 11448 tablet_bootstrap.cc:492] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: No bootstrap required, opened a new log
I20260808 02:37:22.569288 11448 ts_tablet_manager.cc:1397] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:37:22.571020 11447 tablet_bootstrap.cc:492] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: No bootstrap required, opened a new log
I20260808 02:37:22.571331 11447 ts_tablet_manager.cc:1397] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 02:37:22.580291 11447 raft_consensus.cc:348] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.580780 11447 raft_consensus.cc:374] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:22.580892 11447 raft_consensus.cc:729] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4215a5064d04898acf016bf2316ee58, State: Initialized, Role: FOLLOWER
I20260808 02:37:22.580850 11448 raft_consensus.cc:348] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.580850 11446 raft_consensus.cc:348] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.581532 11446 raft_consensus.cc:374] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:22.581528 11448 raft_consensus.cc:374] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:22.581655 11446 raft_consensus.cc:729] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b32735c285247ea86968c8a012a8441, State: Initialized, Role: FOLLOWER
I20260808 02:37:22.581655 11448 raft_consensus.cc:729] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb6ddb29bf4f41fa88dd6c83a310200f, State: Initialized, Role: FOLLOWER
I20260808 02:37:22.581696 11447 consensus_queue.cc:260] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.582324 11448 consensus_queue.cc:260] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.582314 11446 consensus_queue.cc:260] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.583539 11280 heartbeater.cc:503] Master 127.10.20.126:35389 was elected leader, sending a full tablet report...
I20260808 02:37:22.584447 11447 ts_tablet_manager.cc:1428] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260808 02:37:22.586534 11446 ts_tablet_manager.cc:1428] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260808 02:37:22.586758 11448 ts_tablet_manager.cc:1428] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: Time spent starting tablet: real 0.017s user 0.020s sys 0.000s
I20260808 02:37:22.588083 11424 heartbeater.cc:503] Master 127.10.20.126:35389 was elected leader, sending a full tablet report...
I20260808 02:37:22.599764 11453 raft_consensus.cc:482] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:22.600162 11453 raft_consensus.cc:504] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.602558 11453 leader_election.cc:288] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b32735c285247ea86968c8a012a8441 (127.10.20.67:37519), f4215a5064d04898acf016bf2316ee58 (127.10.20.66:44803)
I20260808 02:37:22.610419 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.603103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:34729 (local address 127.10.20.67:37519)
0808 02:37:22.603338 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.603345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.604126 (+ 781us) server_negotiation.cc:407] Connection header received
0808 02:37:22.604306 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.604312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.604394 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.604501 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:22.605289 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.606212 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.608389 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.609266 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.609441 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.609539 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.609982 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.610151 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:37:22.610486 11455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.602965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37519 (local address 127.10.20.65:34729)
0808 02:37:22.603957 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:22.603983 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:22.604155 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:22.604552 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:22.604557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:22.604582 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:22.605118 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.605134 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.606352 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.606358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.608204 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.608221 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.609531 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.609539 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.609771 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.609802 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 02:37:22.609897 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 02:37:22.610011 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":844,"mutex_wait_us":2,"thread_start_us":542,"threads_started":1}
I20260808 02:37:22.610610 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.603202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:58823 (local address 127.10.20.66:44803)
0808 02:37:22.603431 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.603438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.604311 (+ 873us) server_negotiation.cc:407] Connection header received
0808 02:37:22.604536 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.604542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.604626 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.604738 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:22.605481 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.606495 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.608516 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.609295 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.609487 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.609573 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.610193 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.610337 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:37:22.611104 11456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.603169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:44803 (local address 127.10.20.65:58823)
0808 02:37:22.604139 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:22.604158 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:22.604372 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:22.604765 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:22.604768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:22.604793 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:22.605261 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.605273 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.606663 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.606668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.608332 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:22.608349 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.609585 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.609594 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:22.609987 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.610031 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 02:37:22.610133 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 02:37:22.610289 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"mutex_wait_us":148,"thread_start_us":579,"threads_started":1}
I20260808 02:37:22.611950 11375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c7a755a0354052ac22010065b4fe0b" candidate_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b32735c285247ea86968c8a012a8441" is_pre_election: true
I20260808 02:37:22.612210 11231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c7a755a0354052ac22010065b4fe0b" candidate_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4215a5064d04898acf016bf2316ee58" is_pre_election: true
I20260808 02:37:22.612900 11375 raft_consensus.cc:2454] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb6ddb29bf4f41fa88dd6c83a310200f in term 0.
I20260808 02:37:22.613896 11019 leader_election.cc:302] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b32735c285247ea86968c8a012a8441, eb6ddb29bf4f41fa88dd6c83a310200f; no voters:
I20260808 02:37:22.614354 11453 raft_consensus.cc:2781] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:22.614533 11453 raft_consensus.cc:482] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:22.614646 11453 raft_consensus.cc:3037] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:22.614900 11231 raft_consensus.cc:2454] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb6ddb29bf4f41fa88dd6c83a310200f in term 0.
I20260808 02:37:22.617529 11453 raft_consensus.cc:504] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.618508 11453 leader_election.cc:288] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [CANDIDATE]: Term 1 election: Requested vote from peers 9b32735c285247ea86968c8a012a8441 (127.10.20.67:37519), f4215a5064d04898acf016bf2316ee58 (127.10.20.66:44803)
I20260808 02:37:22.619133 11375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c7a755a0354052ac22010065b4fe0b" candidate_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b32735c285247ea86968c8a012a8441"
I20260808 02:37:22.619146 11231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c7a755a0354052ac22010065b4fe0b" candidate_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4215a5064d04898acf016bf2316ee58"
I20260808 02:37:22.619390 11375 raft_consensus.cc:3037] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:22.619397 11231 raft_consensus.cc:3037] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:22.621860 11375 raft_consensus.cc:2454] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb6ddb29bf4f41fa88dd6c83a310200f in term 1.
I20260808 02:37:22.621851 11231 raft_consensus.cc:2454] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb6ddb29bf4f41fa88dd6c83a310200f in term 1.
I20260808 02:37:22.622426 11019 leader_election.cc:302] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b32735c285247ea86968c8a012a8441, eb6ddb29bf4f41fa88dd6c83a310200f; no voters:
I20260808 02:37:22.622860 11453 raft_consensus.cc:2781] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:22.623397 11453 raft_consensus.cc:686] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [term 1 LEADER]: Becoming Leader. State: Replica: eb6ddb29bf4f41fa88dd6c83a310200f, State: Running, Role: LEADER
I20260808 02:37:22.624003 11453 consensus_queue.cc:237] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } }
I20260808 02:37:22.630203 10932 catalog_manager.cc:5495] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb6ddb29bf4f41fa88dd6c83a310200f (127.10.20.65). New cstate: current_term: 1 leader_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b32735c285247ea86968c8a012a8441" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4215a5064d04898acf016bf2316ee58" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb6ddb29bf4f41fa88dd6c83a310200f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34989 } health_report { overall_health: HEALTHY } } }
W20260808 02:37:22.631742 11425 tablet.cc:2369] T c6c7a755a0354052ac22010065b4fe0b P 9b32735c285247ea86968c8a012a8441: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:22.673022 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.654724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40084 (local address 127.10.20.65:34989)
0808 02:37:22.654961 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.654966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.655647 (+ 681us) server_negotiation.cc:407] Connection header received
0808 02:37:22.655874 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.655884 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.655955 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.656100 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.657777 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.658529 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.659926 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.660386 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.660544 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.666024 (+ 5480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.666047 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.666066 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.666113 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.669612 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.670552 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.670562 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.670564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.670836 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.671295 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.671300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.671303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.671719 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.672076 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.672389 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.672658 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260808 02:37:22.699337 11139 tablet.cc:2369] T c6c7a755a0354052ac22010065b4fe0b P eb6ddb29bf4f41fa88dd6c83a310200f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:22.742863 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.724480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40086 (local address 127.10.20.65:34989)
0808 02:37:22.724939 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.724948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.725369 (+ 421us) server_negotiation.cc:407] Connection header received
0808 02:37:22.725651 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.725656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.725732 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.725860 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.727671 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.728570 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.730129 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.730619 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.730848 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.735760 (+ 4912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.735766 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.735770 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.735825 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.739360 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.740301 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.740308 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.740312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.740512 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.741086 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.741092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.741096 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.741424 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.741778 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.742117 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.742391 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266}
W20260808 02:37:22.782030 11281 tablet.cc:2369] T c6c7a755a0354052ac22010065b4fe0b P f4215a5064d04898acf016bf2316ee58: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:22.811324 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.793152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.10.20.65:34989)
0808 02:37:22.793374 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.793381 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.793797 (+ 416us) server_negotiation.cc:407] Connection header received
0808 02:37:22.793964 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.793972 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.794092 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.794244 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.795993 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.796932 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.798625 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.799313 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.799437 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.804860 (+ 5423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.804866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.804870 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.804915 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.808299 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.809180 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.809186 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.809188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.809348 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.809812 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.809816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.809818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.810132 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.810348 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.810830 (+ 482us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.811049 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 02:37:22.813818 11048 tablet_service.cc:2908] Rejecting scan request for tablet c6c7a755a0354052ac22010065b4fe0b: Uninitialized: clean time has not yet been initialized
I20260808 02:37:22.819607 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11001
I20260808 02:37:22.834518 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.820627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40100 (local address 127.10.20.65:34989)
0808 02:37:22.820873 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.820883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.821253 (+ 370us) server_negotiation.cc:407] Connection header received
0808 02:37:22.821486 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.821492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.821605 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.821721 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.823163 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.823893 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.825176 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.825617 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.825764 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.828460 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.828465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.828469 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.828508 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.831594 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.832388 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.832397 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.832402 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.832559 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.832967 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.832975 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.832978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.833258 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.833535 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.833876 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.834168 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:37:22.835449 11133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:22.936162 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11001
I20260808 02:37:22.960460 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11144
Aug 08 02:37:22 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:37:22.978809 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:22.961424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40788 (local address 127.10.20.66:44803)
0808 02:37:22.961652 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:22.961658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:22.961679 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:37:22.961910 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:22.961916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:22.962019 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:22.962147 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:22.963579 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.964391 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.965779 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:22.966216 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:22.966373 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:22.971550 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:22.971568 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:22.971587 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:22.971637 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:22.975348 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.976203 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.976212 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.976215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.976376 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:22.976806 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:22.976812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:22.976815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:22.977237 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:22.977612 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:22.977927 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 02:37:22.978183 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:37:22.979678 11274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:23.076160 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11144
I20260808 02:37:23.096293 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11286
Aug 08 02:37:23 dist-test-slave-8tdl krb5kdc[10887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:37:23.113574 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:23.097120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50228 (local address 127.10.20.67:37519)
0808 02:37:23.097315 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:23.097320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:23.097424 (+ 104us) server_negotiation.cc:407] Connection header received
0808 02:37:23.097662 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:23.097667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:23.097743 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:23.097845 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:23.099433 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:23.100291 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:23.101722 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:23.102182 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:23.102287 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:23.107324 (+ 5037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:23.107342 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:23.107359 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:23.107413 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:23.110287 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:23.111246 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:23.111255 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:23.111258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:23.111428 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:23.111859 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:23.111863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:23.111865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:23.112274 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:23.112599 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:23.112951 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 02:37:23.113217 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:37:23.114293 11418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:23.211405 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11286
I20260808 02:37:23.231074 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 10901
I20260808 02:37:23.232539 10967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:23.352579 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 10901
2026-08-08T02:37:23Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4807 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:23 dist-test-slave-8tdl krb5kdc[11476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:23 dist-test-slave-8tdl krb5kdc[11476](info): set up 2 sockets
Aug 08 02:37:23 dist-test-slave-8tdl krb5kdc[11476](info): commencing operation
krb5kdc: starting...
W20260808 02:37:24.531740 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.009s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:24 dist-test-slave-8tdl krb5kdc[11476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:24.804466 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35141
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:35141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:25.178982 11491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:25.179388 11491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:25.179559 11491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:25.187388 11491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:25.187563 11491 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 02:37:25.187669 11491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:25.187789 11491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:25.187876 11491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:25.187971 11491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:25.200403 11491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:35141
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:25.201891 11491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:25.204623 11491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:25.222751 11497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:25.222589 11500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:25.222826 11498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:25.223891 11491 server_base.cc:1034] running on GCE node
I20260808 02:37:25.225085 11491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:25.227238 11491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:25.228528 11491 hybrid_clock.cc:648] HybridClock initialized: now 1786156645228455 us; error 44 us; skew 500 ppm
I20260808 02:37:25.229025 11491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:25 dist-test-slave-8tdl krb5kdc[11476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156645, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:25.233667 11491 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:25.236128 11491 webserver.cc:460] Webserver started at http://127.10.20.126:39139/ using document root <none> and password file <none>
I20260808 02:37:25.237916 11491 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:25.238081 11491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:25.238463 11491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:25.242475 11491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "cbdadefb0c654f21a4d6f6cc584cd20e"
format_stamp: "Formatted at 2026-08-08 02:37:25 on dist-test-slave-8tdl"
server_key: "5e98fcb6f2643dc6c4291bb32649ebdf"
server_key_iv: "5560f50b25d695b0fd97d21c22b843e4"
server_key_version: "encryptionkey@0"
I20260808 02:37:25.243597 11491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "cbdadefb0c654f21a4d6f6cc584cd20e"
format_stamp: "Formatted at 2026-08-08 02:37:25 on dist-test-slave-8tdl"
server_key: "5e98fcb6f2643dc6c4291bb32649ebdf"
server_key_iv: "5560f50b25d695b0fd97d21c22b843e4"
server_key_version: "encryptionkey@0"
I20260808 02:37:25.250973 11491 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260808 02:37:25.256317 11508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:25.258625 11491 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.003s
I20260808 02:37:25.258888 11491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "cbdadefb0c654f21a4d6f6cc584cd20e"
format_stamp: "Formatted at 2026-08-08 02:37:25 on dist-test-slave-8tdl"
server_key: "5e98fcb6f2643dc6c4291bb32649ebdf"
server_key_iv: "5560f50b25d695b0fd97d21c22b843e4"
server_key_version: "encryptionkey@0"
I20260808 02:37:25.259135 11491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:25.283051 11491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:25.288440 11491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:25.288717 11491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:25.315237 11491 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:35141
I20260808 02:37:25.315256 11574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:35141 every 8 connection(s)
I20260808 02:37:25.317550 11491 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:25.322356 11575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:25.323772 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11491
I20260808 02:37:25.324178 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:25.324978 10321 external_mini_cluster.cc:1428] Setting key 74b2d69cd84e17ecee0331990c63c1f5
I20260808 02:37:25.336475 11575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: Bootstrap starting.
I20260808 02:37:25.341804 11575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: Neither blocks nor log segments found. Creating new log.
Aug 08 02:37:25 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:25.343447 11575 log.cc:824] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:25.347498 11575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: No bootstrap required, opened a new log
I20260808 02:37:25.354054 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:25.327556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.10.20.126:35141)
0808 02:37:25.328548 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:25.328562 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:25.328611 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:37:25.330487 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:25.330520 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:25.331061 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:25.331462 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:25.333433 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:25.335314 (+ 1881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:25.337213 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:25.337984 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:25.338155 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:25.344505 (+ 6350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:25.344517 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:25.344536 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:25.344617 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:25.348476 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:25.349372 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:25.349385 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:25.349394 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:25.349584 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:25.350058 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:25.350073 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:25.350076 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:25.350787 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:25.351671 (+ 884us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:25.352136 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 02:37:25.352670 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":477,"threads_started":1}
I20260808 02:37:25.359141 11575 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35141 } }
I20260808 02:37:25.359694 11575 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:25.359850 11575 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbdadefb0c654f21a4d6f6cc584cd20e, State: Initialized, Role: FOLLOWER
I20260808 02:37:25.360535 11575 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35141 } }
I20260808 02:37:25.360786 11575 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:25.360896 11575 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:25.361106 11575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:25.363817 11575 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35141 } }
I20260808 02:37:25.365134 11575 leader_election.cc:302] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbdadefb0c654f21a4d6f6cc584cd20e; no voters:
I20260808 02:37:25.366102 11575 leader_election.cc:288] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:25.366211 11581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:25.367479 11581 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [term 1 LEADER]: Becoming Leader. State: Replica: cbdadefb0c654f21a4d6f6cc584cd20e, State: Running, Role: LEADER
I20260808 02:37:25.368079 11581 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35141 } }
I20260808 02:37:25.369050 11575 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:25.371747 11583 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbdadefb0c654f21a4d6f6cc584cd20e. Latest consensus state: current_term: 1 leader_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35141 } } }
I20260808 02:37:25.372248 11583 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:25.373121 11582 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdadefb0c654f21a4d6f6cc584cd20e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35141 } } }
I20260808 02:37:25.373452 11582 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:25.373603 11588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:25.382313 11588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:25.394222 11588 catalog_manager.cc:1347] Generated new cluster ID: 3affe9db530142c7acec4f070496594a
I20260808 02:37:25.394521 11588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:25.417371 11588 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:25.419870 11588 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:25.438144 11588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: Generated new TSK 0
I20260808 02:37:25.439234 11588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:25.516036 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35141
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:25.903054 11603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:25.903378 11603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:25.903568 11603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:25.911542 11603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:25.911688 11603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:25.911852 11603 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:37:25.911974 11603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:25.923147 11603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:35141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:25.924646 11603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:25.926190 11603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:25.941905 11609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:25.942162 11608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:25.942133 11611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:25.943071 11603 server_base.cc:1034] running on GCE node
I20260808 02:37:25.943933 11603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:25.945426 11603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:25.946836 11603 hybrid_clock.cc:648] HybridClock initialized: now 1786156645946729 us; error 86 us; skew 500 ppm
I20260808 02:37:25.947222 11603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:25 dist-test-slave-8tdl krb5kdc[11476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156645, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:25.957597 11603 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:25.959858 11603 webserver.cc:460] Webserver started at http://127.10.20.65:45617/ using document root <none> and password file <none>
I20260808 02:37:25.960731 11603 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:25.960848 11603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:25.961184 11603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:25.964802 11603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "e1c55c4f3b94491f8af979af83b7a2ba"
format_stamp: "Formatted at 2026-08-08 02:37:25 on dist-test-slave-8tdl"
server_key: "ac03001f381297f72a3f8cd742a2a9ca"
server_key_iv: "ee5636fed16239319baddc4680137061"
server_key_version: "encryptionkey@0"
I20260808 02:37:25.966070 11603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "e1c55c4f3b94491f8af979af83b7a2ba"
format_stamp: "Formatted at 2026-08-08 02:37:25 on dist-test-slave-8tdl"
server_key: "ac03001f381297f72a3f8cd742a2a9ca"
server_key_iv: "ee5636fed16239319baddc4680137061"
server_key_version: "encryptionkey@0"
I20260808 02:37:25.972858 11603 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:37:25.977790 11618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:25.979599 11603 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:37:25.979815 11603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "e1c55c4f3b94491f8af979af83b7a2ba"
format_stamp: "Formatted at 2026-08-08 02:37:25 on dist-test-slave-8tdl"
server_key: "ac03001f381297f72a3f8cd742a2a9ca"
server_key_iv: "ee5636fed16239319baddc4680137061"
server_key_version: "encryptionkey@0"
I20260808 02:37:25.980104 11603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:26.008356 11603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:26.014104 11603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:26.014546 11603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:26.018182 11603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:26.018291 11603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:26.018487 11603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:26.018581 11603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:37:26 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156645, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:26.048128 11627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.019655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:33753 (local address 127.10.20.126:35141)
0808 02:37:26.020214 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:26.020219 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:26.021656 (+ 1437us) server_negotiation.cc:407] Connection header received
0808 02:37:26.024615 (+ 2959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:26.024622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:26.024734 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:26.024807 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:26.028011 (+ 3204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.029156 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.031929 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.032575 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.032742 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.038828 (+ 6086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:26.038838 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:26.038845 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:26.038913 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:26.042765 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.044720 (+ 1955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.044728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.044731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.044918 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.045684 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.045691 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.045694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.046005 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:26.046204 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:26.047442 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0808 02:37:26.047714 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":310,"threads_started":1}
I20260808 02:37:26.049252 11628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.020430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.10.20.65:33753)
0808 02:37:26.021444 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:26.021504 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:26.024144 (+ 2640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:26.025469 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:26.025508 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:26.026565 (+ 1057us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:26.027766 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.027800 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.029399 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.029403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.031698 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.031732 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.032897 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.032905 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.033304 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.034534 (+ 1230us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:26.034571 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:26.038412 (+ 3841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:26.043040 (+ 4628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.043055 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.043079 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.044491 (+ 1412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.045079 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.045087 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.045094 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.045514 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.046314 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:26.046323 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:26.046946 (+ 623us) client_negotiation.cc:769] Sending connection context
0808 02:37:26.047332 (+ 386us) client_negotiation.cc:240] Negotiation successful
0808 02:37:26.047958 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":422,"threads_started":1}
I20260808 02:37:26.075392 11627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.057837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:49617 (local address 127.10.20.126:35141)
0808 02:37:26.058128 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:26.058138 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:26.058221 (+ 83us) server_negotiation.cc:407] Connection header received
0808 02:37:26.058441 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:26.058450 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:26.058565 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:26.058750 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:26.059868 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.061351 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.062954 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.063648 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.063816 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.066538 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:26.066543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:26.066547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:26.066583 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:26.070966 (+ 4383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.072293 (+ 1327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.072303 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.072307 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.072534 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.073142 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.073151 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.073157 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.073635 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:26.073951 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:26.074615 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 02:37:26.074998 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:37:26.075858 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.057428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.10.20.65:49617)
0808 02:37:26.058088 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:26.058111 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:26.058299 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:26.058792 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:26.058795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:26.059298 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:26.059682 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.059692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.061566 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.061571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.062772 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.062788 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.063871 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.063879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.064065 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.064870 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:26.064890 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:26.066193 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:26.071258 (+ 5065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.071267 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.071277 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.072099 (+ 822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.072728 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.072734 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.072738 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.072907 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.073906 (+ 999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:26.073913 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:26.074235 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 02:37:26.074474 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 02:37:26.075138 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":496,"threads_started":1}
I20260808 02:37:26.081698 11603 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:34839
I20260808 02:37:26.081746 11745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:34839 every 8 connection(s)
I20260808 02:37:26.083249 11603 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:26.086345 11747 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35141
I20260808 02:37:26.086759 11747 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:26.087563 11747 heartbeater.cc:511] Master 127.10.20.126:35141 requested a full tablet report, sending...
I20260808 02:37:26.088204 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11603
I20260808 02:37:26.088605 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:26.089318 10321 external_mini_cluster.cc:1428] Setting key 86292a351238bddd0015a6fd688883e0
I20260808 02:37:26.090364 11526 ts_manager.cc:194] Registered new tserver with Master: e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839)
I20260808 02:37:26.092139 11526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:33753
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:26.152719 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35141
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:26.533119 11751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:26.533453 11751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:26.533649 11751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:26.541406 11751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:26.541553 11751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:26.541694 11751 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:37:26.541862 11751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:26.553119 11751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:35141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:26.554628 11751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:26.556236 11751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:26.571942 11759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:26.572023 11757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:26.572027 11756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:26.573021 11751 server_base.cc:1034] running on GCE node
I20260808 02:37:26.573748 11751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:26.574909 11751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:26.576232 11751 hybrid_clock.cc:648] HybridClock initialized: now 1786156646576125 us; error 68 us; skew 500 ppm
I20260808 02:37:26.576705 11751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:26 dist-test-slave-8tdl krb5kdc[11476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156646, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:26.580749 11751 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:26.582840 11751 webserver.cc:460] Webserver started at http://127.10.20.66:46373/ using document root <none> and password file <none>
I20260808 02:37:26.583781 11751 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:26.583943 11751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:26.584384 11751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:26.587949 11751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "8399ea7c20064b4abf7ef8105fa3f2af"
format_stamp: "Formatted at 2026-08-08 02:37:26 on dist-test-slave-8tdl"
server_key: "eb8cfd10165ef8dbc76224a051e75294"
server_key_iv: "1712b5ef99596e3e8239f8419bac3336"
server_key_version: "encryptionkey@0"
I20260808 02:37:26.588930 11751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "8399ea7c20064b4abf7ef8105fa3f2af"
format_stamp: "Formatted at 2026-08-08 02:37:26 on dist-test-slave-8tdl"
server_key: "eb8cfd10165ef8dbc76224a051e75294"
server_key_iv: "1712b5ef99596e3e8239f8419bac3336"
server_key_version: "encryptionkey@0"
I20260808 02:37:26.595439 11751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 02:37:26.600343 11766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:26.602020 11751 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:26.602270 11751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "8399ea7c20064b4abf7ef8105fa3f2af"
format_stamp: "Formatted at 2026-08-08 02:37:26 on dist-test-slave-8tdl"
server_key: "eb8cfd10165ef8dbc76224a051e75294"
server_key_iv: "1712b5ef99596e3e8239f8419bac3336"
server_key_version: "encryptionkey@0"
I20260808 02:37:26.602571 11751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:26.630604 11751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:26.636546 11751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:26.636921 11751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:26.640635 11751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:26.640781 11751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:26.641041 11751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:26.641139 11751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:37:26 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156646, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:26.669757 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.641083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:48919 (local address 127.10.20.126:35141)
0808 02:37:26.641598 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:26.641605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:26.643151 (+ 1546us) server_negotiation.cc:407] Connection header received
0808 02:37:26.645336 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:26.645342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:26.645455 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:26.645585 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:26.648371 (+ 2786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.649948 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.652578 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.653189 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.653355 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.660420 (+ 7065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:26.660432 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:26.660438 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:26.660501 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:26.664754 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.666489 (+ 1735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.666497 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.666501 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.666753 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.667481 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.667486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.667490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.667811 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:26.668011 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:26.668949 (+ 938us) server_negotiation.cc:299] Negotiation successful
0808 02:37:26.669288 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":242,"threads_started":1}
I20260808 02:37:26.671619 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.641897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.10.20.66:48919)
0808 02:37:26.642898 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:26.642963 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:26.644996 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:26.645860 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:26.645869 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:26.646769 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:26.647979 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.648007 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.650208 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.650216 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.652363 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.652383 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.653498 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.653507 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.653776 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.654853 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:26.654898 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:26.659907 (+ 5009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:26.664990 (+ 5083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.665001 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.665022 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.666248 (+ 1226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.666954 (+ 706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.666961 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.666967 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.667327 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.667975 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:26.667984 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:26.668469 (+ 485us) client_negotiation.cc:769] Sending connection context
0808 02:37:26.668782 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 02:37:26.669551 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":435,"threads_started":1}
I20260808 02:37:26.699879 11751 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:37811
I20260808 02:37:26.700300 11848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.680416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.10.20.66:51569)
0808 02:37:26.681263 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:26.681301 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:26.681613 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:26.682310 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:26.682319 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:26.683630 (+ 1311us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:26.684347 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.684376 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.685973 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.685979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.688242 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:26.688275 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.689510 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.689519 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:26.689701 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.690437 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:26.690456 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:26.691888 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:26.696831 (+ 4943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.696840 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.696849 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.697514 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.698040 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:26.698045 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:26.698049 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:26.698203 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:26.699025 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:26.699029 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:26.699250 (+ 221us) client_negotiation.cc:769] Sending connection context
0808 02:37:26.699380 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 02:37:26.699692 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":423,"threads_started":1}
I20260808 02:37:26.700740 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:26.680527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:51569 (local address 127.10.20.126:35141)
0808 02:37:26.680795 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:26.680803 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:26.681458 (+ 655us) server_negotiation.cc:407] Connection header received
0808 02:37:26.681961 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:26.681976 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:26.682089 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:26.682238 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:26.684587 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.685793 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.688595 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:26.689257 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:26.689424 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:26.692266 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:26.692272 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:26.692275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:26.692341 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:26.696551 (+ 4210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.697762 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.697766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.697768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.697903 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:26.698345 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:26.698350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:26.698352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:26.698823 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:26.700050 (+ 1227us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:26.700222 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 02:37:26.700506 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:37:26.701745 11751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:26.699898 11894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:37811 every 8 connection(s)
I20260808 02:37:26.704420 11895 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35141
I20260808 02:37:26.705224 11895 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:26.705967 11895 heartbeater.cc:511] Master 127.10.20.126:35141 requested a full tablet report, sending...
I20260808 02:37:26.707626 11526 ts_manager.cc:194] Registered new tserver with Master: 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811)
I20260808 02:37:26.708549 11526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:48919
I20260808 02:37:26.712021 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11751
I20260808 02:37:26.712255 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:26.712744 10321 external_mini_cluster.cc:1428] Setting key c1a6d73a3c74d2f1ed480e8a7bcd78be
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:26.780009 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35141
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:27.095713 11747 heartbeater.cc:503] Master 127.10.20.126:35141 was elected leader, sending a full tablet report...
W20260808 02:37:27.161479 11899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:27.161856 11899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:27.162045 11899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:27.170363 11899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:27.170501 11899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:27.170732 11899 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:37:27.170864 11899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:27.182061 11899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:35141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:27.183650 11899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:27.185127 11899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:27.200881 11904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:27.200842 11907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:27.200918 11905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:27.208794 11899 server_base.cc:1034] running on GCE node
I20260808 02:37:27.209576 11899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:27.210721 11899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:27.212175 11899 hybrid_clock.cc:648] HybridClock initialized: now 1786156647212097 us; error 38 us; skew 500 ppm
I20260808 02:37:27.212636 11899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:27 dist-test-slave-8tdl krb5kdc[11476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:27.217082 11899 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:27.219084 11899 webserver.cc:460] Webserver started at http://127.10.20.67:41819/ using document root <none> and password file <none>
I20260808 02:37:27.220005 11899 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:27.220119 11899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:27.220563 11899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:27.224222 11899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "f4fde726d43844dca30ea009d1fce702"
format_stamp: "Formatted at 2026-08-08 02:37:27 on dist-test-slave-8tdl"
server_key: "c3d5ca88ad5fdea3b5cc47bd4115de6e"
server_key_iv: "c89c4019149aa16843bd54e27a99e7a6"
server_key_version: "encryptionkey@0"
I20260808 02:37:27.225231 11899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "f4fde726d43844dca30ea009d1fce702"
format_stamp: "Formatted at 2026-08-08 02:37:27 on dist-test-slave-8tdl"
server_key: "c3d5ca88ad5fdea3b5cc47bd4115de6e"
server_key_iv: "c89c4019149aa16843bd54e27a99e7a6"
server_key_version: "encryptionkey@0"
I20260808 02:37:27.231820 11899 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:37:27.236359 11914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:27.238327 11899 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:27.238601 11899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "f4fde726d43844dca30ea009d1fce702"
format_stamp: "Formatted at 2026-08-08 02:37:27 on dist-test-slave-8tdl"
server_key: "c3d5ca88ad5fdea3b5cc47bd4115de6e"
server_key_iv: "c89c4019149aa16843bd54e27a99e7a6"
server_key_version: "encryptionkey@0"
I20260808 02:37:27.239004 11899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:27.258172 11899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:27.263769 11899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:27.264127 11899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:27.267970 11899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:27.268121 11899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:27.268342 11899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:27.268430 11899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:37:27 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:27.297780 11922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.268253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:41165 (local address 127.10.20.126:35141)
0808 02:37:27.268888 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.268896 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.270279 (+ 1383us) server_negotiation.cc:407] Connection header received
0808 02:37:27.274099 (+ 3820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.274112 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.274206 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.274365 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:27.277628 (+ 3263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.278870 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.283121 (+ 4251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.283868 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.284078 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.289228 (+ 5150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:27.289234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:27.289238 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:27.289279 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:27.292962 (+ 3683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:27.294247 (+ 1285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:27.294252 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:27.294254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:27.294477 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:27.295135 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:27.295140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:27.295144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:27.295482 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:27.295674 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.296733 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.297146 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":382,"threads_started":1}
I20260808 02:37:27.298987 11924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.268985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.10.20.67:41165)
0808 02:37:27.270044 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.270126 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.273542 (+ 3416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.274822 (+ 1280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.274842 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.276093 (+ 1251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:27.277343 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.277392 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.279192 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.279203 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.282658 (+ 3455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.282719 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.284519 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.284528 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.284781 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.285665 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:27.285693 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:27.288896 (+ 3203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:27.293191 (+ 4295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:27.293204 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:27.293228 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:27.294051 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:27.294660 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:27.294667 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:27.294697 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:27.294980 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:27.295638 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:27.295648 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:27.296107 (+ 459us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.296520 (+ 413us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.297021 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":410,"threads_started":1}
I20260808 02:37:27.330207 12003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.309414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.10.20.67:40099)
0808 02:37:27.311447 (+ 2033us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.311471 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.311639 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.312134 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.312143 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.312866 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:27.313382 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.313399 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.314659 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.314668 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.317269 (+ 2601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.317302 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.318590 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.318601 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.318980 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.320032 (+ 1052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:27.320071 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:27.321806 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:27.325793 (+ 3987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:27.325805 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:27.325810 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:27.326558 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:27.327144 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:27.327148 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:27.327152 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:27.327367 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:27.328396 (+ 1029us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:27.328420 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:27.328716 (+ 296us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.328961 (+ 245us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.329525 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1840,"thread_start_us":1593,"threads_started":1}
I20260808 02:37:27.331872 11922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.309432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:40099 (local address 127.10.20.126:35141)
0808 02:37:27.309725 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.309733 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.311624 (+ 1891us) server_negotiation.cc:407] Connection header received
0808 02:37:27.311769 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.311779 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.311904 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.312075 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:27.313602 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.314460 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.317535 (+ 3075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.318292 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.318442 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.322120 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:27.322126 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:27.322129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:27.322165 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:27.325544 (+ 3379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:27.326759 (+ 1215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:27.326765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:27.326769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:27.326986 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:27.327559 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:27.327568 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:27.327574 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:27.328083 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:27.328305 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.330972 (+ 2667us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.331336 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:37:27.341367 12041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:46837 every 8 connection(s)
I20260808 02:37:27.341360 11899 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:46837
I20260808 02:37:27.342911 11899 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:27.346107 12042 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35141
I20260808 02:37:27.346427 12042 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:27.347388 12042 heartbeater.cc:511] Master 127.10.20.126:35141 requested a full tablet report, sending...
I20260808 02:37:27.349212 11526 ts_manager.cc:194] Registered new tserver with Master: f4fde726d43844dca30ea009d1fce702 (127.10.20.67:46837)
I20260808 02:37:27.350327 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 11899
I20260808 02:37:27.350430 11526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:41165
I20260808 02:37:27.350601 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:27.351315 10321 external_mini_cluster.cc:1428] Setting key e9ffe0a28775f4899fe66d976b3ff444
I20260808 02:37:27.355525 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:37:27 dist-test-slave-8tdl krb5kdc[11476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:37:27 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:27.419965 11922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.403319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39220 (local address 127.10.20.126:35141)
0808 02:37:27.403564 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.403569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.403958 (+ 389us) server_negotiation.cc:407] Connection header received
0808 02:37:27.404166 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.404170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.404242 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.404393 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:27.406142 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.407133 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.408653 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.409214 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.409360 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.413934 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:27.413941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:27.413945 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:27.413990 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:27.416869 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:27.417674 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:27.417679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:27.417681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:27.417899 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:27.418345 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:27.418350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:27.418352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:27.418652 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:27.419008 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.419377 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.419585 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:37:27.424803 11526 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:27.432148 11526 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:27.469762 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.447038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.10.20.65:34839)
0808 02:37:27.460788 (+ 13750us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.460799 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.460838 (+ 39us) server_negotiation.cc:407] Connection header received
0808 02:37:27.460957 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.460964 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.461177 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.461435 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:27.462253 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.463937 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.466918 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.468343 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.468512 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.468757 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.469203 (+ 446us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.469431 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13576,"thread_start_us":13431,"threads_started":1}
I20260808 02:37:27.469846 12058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.446580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34839 (local address 127.0.0.1:59090)
0808 02:37:27.458437 (+ 11857us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.458523 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.458890 (+ 367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.461450 (+ 2560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.461458 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.461489 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:27.462004 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.462025 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.464165 (+ 2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.464171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.466633 (+ 2462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.466653 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.468591 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.468598 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.468932 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.468979 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.469140 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.469378 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11435,"mutex_wait_us":170,"thread_start_us":13548,"threads_started":1}
I20260808 02:37:27.470490 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.447381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:37811 (local address 127.0.0.1:41382)
0808 02:37:27.460452 (+ 13071us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.460473 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.460735 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.461719 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.461723 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.461744 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:27.462221 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.462232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.464151 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.464159 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.466886 (+ 2727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.466906 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.469122 (+ 2216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.469130 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.469406 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.469445 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.469572 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.469723 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12920,"mutex_wait_us":94,"thread_start_us":11796,"threads_started":1}
I20260808 02:37:27.471503 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.448689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.10.20.66:37811)
0808 02:37:27.456628 (+ 7939us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.456643 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.460615 (+ 3972us) server_negotiation.cc:407] Connection header received
0808 02:37:27.460990 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.461003 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.461363 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.461623 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:27.462407 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.463971 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.467117 (+ 3146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.468601 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.468739 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.468960 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.470916 (+ 1956us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.471134 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7661,"thread_start_us":7480,"threads_started":1}
I20260808 02:37:27.472277 12057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.447097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:46837 (local address 127.0.0.1:33932)
0808 02:37:27.459544 (+ 12447us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.459571 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.459689 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.463645 (+ 3956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.463651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.463678 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:27.464116 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.464133 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.466771 (+ 2638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.466779 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.469011 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.469026 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.471356 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.471364 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.471569 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.471610 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.471690 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.471864 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12300,"mutex_wait_us":33,"thread_start_us":12161,"threads_started":1}
I20260808 02:37:27.473582 12059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.448047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33932 (local address 127.10.20.67:46837)
0808 02:37:27.462985 (+ 14938us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.462994 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.463027 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:37:27.463128 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.463136 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.463418 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.464386 (+ 968us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:27.464774 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.466549 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.469254 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.471113 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.472532 (+ 1419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.472947 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.473038 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.473236 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14728,"thread_start_us":16018,"threads_started":1}
I20260808 02:37:27.474763 11672 tablet_service.cc:1467] Processing CreateTablet for tablet f4d62ff718b44b978dfcbda3f42a7089 (DEFAULT_TABLE table=test-table [id=fc95bf36a63c499fb3e16889b965bc3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:27.475332 11820 tablet_service.cc:1467] Processing CreateTablet for tablet f4d62ff718b44b978dfcbda3f42a7089 (DEFAULT_TABLE table=test-table [id=fc95bf36a63c499fb3e16889b965bc3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:27.476497 11820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d62ff718b44b978dfcbda3f42a7089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:27.476500 11672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d62ff718b44b978dfcbda3f42a7089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:27.477569 11967 tablet_service.cc:1467] Processing CreateTablet for tablet f4d62ff718b44b978dfcbda3f42a7089 (DEFAULT_TABLE table=test-table [id=fc95bf36a63c499fb3e16889b965bc3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:27.479171 11967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d62ff718b44b978dfcbda3f42a7089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:27.489533 12061 tablet_bootstrap.cc:492] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Bootstrap starting.
I20260808 02:37:27.493654 12061 tablet_bootstrap.cc:654] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:27.495002 12061 log.cc:824] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:27.495707 12062 tablet_bootstrap.cc:492] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Bootstrap starting.
I20260808 02:37:27.498869 12064 tablet_bootstrap.cc:492] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Bootstrap starting.
I20260808 02:37:27.500020 12061 tablet_bootstrap.cc:492] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: No bootstrap required, opened a new log
I20260808 02:37:27.500236 12062 tablet_bootstrap.cc:654] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:27.500347 12061 ts_tablet_manager.cc:1397] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260808 02:37:27.501689 12062 log.cc:824] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:27.503691 12064 tablet_bootstrap.cc:654] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:27.504824 12064 log.cc:824] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:27.508224 12064 tablet_bootstrap.cc:492] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: No bootstrap required, opened a new log
I20260808 02:37:27.508543 12064 ts_tablet_manager.cc:1397] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 02:37:27.515311 12062 tablet_bootstrap.cc:492] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: No bootstrap required, opened a new log
I20260808 02:37:27.515111 12061 raft_consensus.cc:348] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.515666 12061 raft_consensus.cc:374] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:27.515683 12062 ts_tablet_manager.cc:1397] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.008s
I20260808 02:37:27.515785 12061 raft_consensus.cc:729] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8399ea7c20064b4abf7ef8105fa3f2af, State: Initialized, Role: FOLLOWER
I20260808 02:37:27.516582 12061 consensus_queue.cc:260] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.517882 11895 heartbeater.cc:503] Master 127.10.20.126:35141 was elected leader, sending a full tablet report...
I20260808 02:37:27.518667 12061 ts_tablet_manager.cc:1428] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Time spent starting tablet: real 0.018s user 0.011s sys 0.008s
I20260808 02:37:27.519568 12064 raft_consensus.cc:348] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.520123 12064 raft_consensus.cc:374] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:27.520237 12064 raft_consensus.cc:729] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4fde726d43844dca30ea009d1fce702, State: Initialized, Role: FOLLOWER
I20260808 02:37:27.520969 12064 consensus_queue.cc:260] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.522318 12042 heartbeater.cc:503] Master 127.10.20.126:35141 was elected leader, sending a full tablet report...
I20260808 02:37:27.523204 12064 ts_tablet_manager.cc:1428] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260808 02:37:27.526912 12062 raft_consensus.cc:348] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.527508 12062 raft_consensus.cc:374] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:27.527644 12062 raft_consensus.cc:729] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c55c4f3b94491f8af979af83b7a2ba, State: Initialized, Role: FOLLOWER
I20260808 02:37:27.528293 12062 consensus_queue.cc:260] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.530368 12062 ts_tablet_manager.cc:1428] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260808 02:37:27.586783 11748 tablet.cc:2369] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:37:27.595171 12043 tablet.cc:2369] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:37:27.704592 11896 tablet.cc:2369] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:27.911616 12068 raft_consensus.cc:482] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:27.911898 12068 raft_consensus.cc:504] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.913666 12068 leader_election.cc:288] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839), 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811)
I20260808 02:37:27.921373 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.914406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44181 (local address 127.10.20.66:37811)
0808 02:37:27.914716 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.914722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.915170 (+ 448us) server_negotiation.cc:407] Connection header received
0808 02:37:27.915357 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.915362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.915454 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.915547 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:27.916174 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.916957 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.919046 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.920198 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.920447 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.920557 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.920950 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.921092 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 02:37:27.921480 12070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.914090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:37811 (local address 127.10.20.67:44181)
0808 02:37:27.915010 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.915033 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.915205 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.915586 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.915591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.915618 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:27.915910 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.915929 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.917125 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.917131 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.918821 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.918839 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.920627 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.920632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.920777 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.920804 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.920920 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.921079 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"thread_start_us":584,"threads_started":1}
I20260808 02:37:27.922152 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.914180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:42901 (local address 127.10.20.65:34839)
0808 02:37:27.914494 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:27.914504 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:27.915367 (+ 863us) server_negotiation.cc:407] Connection header received
0808 02:37:27.915552 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:27.915558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:27.915636 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:27.915739 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:27.916384 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.917209 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.919629 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.920862 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.921091 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.921178 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:27.921791 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 02:37:27.921955 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:37:27.922390 12071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:27.914136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34839 (local address 127.10.20.67:42901)
0808 02:37:27.915195 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:27.915213 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:27.915377 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:27.915766 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:27.915769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:27.915793 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:27.916168 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.916180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.917401 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.917405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.919419 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:27.919435 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:27.921138 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:27.921145 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:27.921343 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:27.921378 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:37:27.921740 (+ 362us) client_negotiation.cc:240] Negotiation successful
0808 02:37:27.921924 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"mutex_wait_us":1,"thread_start_us":707,"threads_started":1}
I20260808 02:37:27.922924 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d62ff718b44b978dfcbda3f42a7089" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" is_pre_election: true
I20260808 02:37:27.923559 11846 raft_consensus.cc:2454] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 0.
I20260808 02:37:27.923722 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d62ff718b44b978dfcbda3f42a7089" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" is_pre_election: true
I20260808 02:37:27.924336 11692 raft_consensus.cc:2454] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 0.
I20260808 02:37:27.924491 11917 leader_election.cc:302] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8399ea7c20064b4abf7ef8105fa3f2af, f4fde726d43844dca30ea009d1fce702; no voters:
I20260808 02:37:27.925030 12068 raft_consensus.cc:2781] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:27.925208 12068 raft_consensus.cc:482] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:27.925328 12068 raft_consensus.cc:3037] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:27.927878 12068 raft_consensus.cc:504] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.928571 12068 leader_election.cc:288] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 election: Requested vote from peers e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839), 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811)
I20260808 02:37:27.929368 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d62ff718b44b978dfcbda3f42a7089" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8399ea7c20064b4abf7ef8105fa3f2af"
I20260808 02:37:27.929378 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d62ff718b44b978dfcbda3f42a7089" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c55c4f3b94491f8af979af83b7a2ba"
I20260808 02:37:27.929659 11692 raft_consensus.cc:3037] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:27.929661 11846 raft_consensus.cc:3037] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:27.933691 11846 raft_consensus.cc:2454] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 1.
I20260808 02:37:27.933691 11692 raft_consensus.cc:2454] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 1.
I20260808 02:37:27.934410 11917 leader_election.cc:302] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8399ea7c20064b4abf7ef8105fa3f2af, e1c55c4f3b94491f8af979af83b7a2ba, f4fde726d43844dca30ea009d1fce702; no voters:
I20260808 02:37:27.934875 12068 raft_consensus.cc:2781] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:27.935433 12068 raft_consensus.cc:686] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 1 LEADER]: Becoming Leader. State: Replica: f4fde726d43844dca30ea009d1fce702, State: Running, Role: LEADER
I20260808 02:37:27.935918 12068 consensus_queue.cc:237] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } }
I20260808 02:37:27.941483 11526 catalog_manager.cc:5495] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4fde726d43844dca30ea009d1fce702 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "f4fde726d43844dca30ea009d1fce702" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } health_report { overall_health: UNKNOWN } } }
I20260808 02:37:28.058234 12080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.050760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33948 (local address 127.10.20.67:46837)
0808 02:37:28.051787 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.051792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.051814 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:37:28.052193 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.052198 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.052346 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.052493 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:28.053070 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.053879 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.055542 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.055982 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.056106 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.056706 (+ 600us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.057429 (+ 723us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.057561 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.057731 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.057813 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924,"thread_start_us":819,"threads_started":1}
I20260808 02:37:28.068547 11846 raft_consensus.cc:1261] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Refusing update from remote peer f4fde726d43844dca30ea009d1fce702: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:28.069200 11692 raft_consensus.cc:1261] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Refusing update from remote peer f4fde726d43844dca30ea009d1fce702: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:28.070034 12072 consensus_queue.cc:1035] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:28.070559 12068 consensus_queue.cc:1035] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:28.135295 11525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:28.135789 11525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:28.142108 11525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: Sending DeleteTablet for 3 replicas of tablet f4d62ff718b44b978dfcbda3f42a7089
I20260808 02:37:28.143790 11672 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d62ff718b44b978dfcbda3f42a7089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:28 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:59090
I20260808 02:37:28.144999 12094 tablet_replica.cc:330] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: stopping tablet replica
I20260808 02:37:28.145802 12094 raft_consensus.cc:2229] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:28.145844 11967 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d62ff718b44b978dfcbda3f42a7089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:28 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:33932
I20260808 02:37:28.146555 12094 raft_consensus.cc:2258] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:28.146970 12095 tablet_replica.cc:330] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: stopping tablet replica
I20260808 02:37:28.147418 11820 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d62ff718b44b978dfcbda3f42a7089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:28 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:41382
I20260808 02:37:28.147483 12095 raft_consensus.cc:2229] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:28.148413 12095 raft_consensus.cc:2258] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:28.148736 11525 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:28.149575 11525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:28.150238 12094 ts_tablet_manager.cc:1905] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:28.150501 12095 ts_tablet_manager.cc:1905] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:28.159078 12094 ts_tablet_manager.cc:1918] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:37:28.159513 12094 log.cc:1196] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/f4d62ff718b44b978dfcbda3f42a7089
I20260808 02:37:28.159747 12095 ts_tablet_manager.cc:1918] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:37:28.159983 12095 log.cc:1196] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/f4d62ff718b44b978dfcbda3f42a7089
I20260808 02:37:28.160396 12094 ts_tablet_manager.cc:1939] T f4d62ff718b44b978dfcbda3f42a7089 P e1c55c4f3b94491f8af979af83b7a2ba: Deleting consensus metadata
I20260808 02:37:28.160658 12095 ts_tablet_manager.cc:1939] T f4d62ff718b44b978dfcbda3f42a7089 P f4fde726d43844dca30ea009d1fce702: Deleting consensus metadata
I20260808 02:37:28.162667 11509 catalog_manager.cc:4841] TS e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839): tablet f4d62ff718b44b978dfcbda3f42a7089 (table test-table [id=fc95bf36a63c499fb3e16889b965bc3e]) successfully deleted
I20260808 02:37:28.163084 11672 tablet_service.cc:1467] Processing CreateTablet for tablet 274b072e50a64bfdb3cc2d9283fda404 (DEFAULT_TABLE table=test-table [id=c3902b7261f34d55b3be27ee502c0787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:28.163584 11672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 274b072e50a64bfdb3cc2d9283fda404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:28.167029 11967 tablet_service.cc:1467] Processing CreateTablet for tablet 274b072e50a64bfdb3cc2d9283fda404 (DEFAULT_TABLE table=test-table [id=c3902b7261f34d55b3be27ee502c0787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:28.167680 11967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 274b072e50a64bfdb3cc2d9283fda404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:28.169726 11819 tablet_service.cc:1467] Processing CreateTablet for tablet 274b072e50a64bfdb3cc2d9283fda404 (DEFAULT_TABLE table=test-table [id=c3902b7261f34d55b3be27ee502c0787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:28.170502 11819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 274b072e50a64bfdb3cc2d9283fda404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:28.175269 12096 tablet_replica.cc:330] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: stopping tablet replica
I20260808 02:37:28.175863 12096 raft_consensus.cc:2229] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:28.176527 12096 raft_consensus.cc:2258] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:28.178802 12096 ts_tablet_manager.cc:1905] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:28.181229 12097 tablet_bootstrap.cc:492] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Bootstrap starting.
I20260808 02:37:28.183498 12097 tablet_bootstrap.cc:654] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:28.187790 12097 tablet_bootstrap.cc:492] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: No bootstrap required, opened a new log
I20260808 02:37:28.189409 12097 ts_tablet_manager.cc:1397] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 02:37:28.190472 12097 raft_consensus.cc:348] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.190797 12096 ts_tablet_manager.cc:1918] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:37:28.190891 12097 raft_consensus.cc:374] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:28.191016 12096 log.cc:1196] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/f4d62ff718b44b978dfcbda3f42a7089
I20260808 02:37:28.191156 12097 raft_consensus.cc:729] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c55c4f3b94491f8af979af83b7a2ba, State: Initialized, Role: FOLLOWER
I20260808 02:37:28.191706 12096 ts_tablet_manager.cc:1939] T f4d62ff718b44b978dfcbda3f42a7089 P 8399ea7c20064b4abf7ef8105fa3f2af: Deleting consensus metadata
I20260808 02:37:28.191569 12097 consensus_queue.cc:260] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.194202 11511 catalog_manager.cc:4841] TS 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811): tablet f4d62ff718b44b978dfcbda3f42a7089 (table test-table [id=fc95bf36a63c499fb3e16889b965bc3e]) successfully deleted
I20260808 02:37:28.194658 11513 catalog_manager.cc:4841] TS f4fde726d43844dca30ea009d1fce702 (127.10.20.67:46837): tablet f4d62ff718b44b978dfcbda3f42a7089 (table test-table [id=fc95bf36a63c499fb3e16889b965bc3e]) successfully deleted
I20260808 02:37:28.195513 12097 ts_tablet_manager.cc:1428] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 02:37:28.198824 12100 tablet_bootstrap.cc:492] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Bootstrap starting.
I20260808 02:37:28.201125 12100 tablet_bootstrap.cc:654] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:28.203426 12099 tablet_bootstrap.cc:492] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Bootstrap starting.
I20260808 02:37:28.206048 12099 tablet_bootstrap.cc:654] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:28.213037 12099 tablet_bootstrap.cc:492] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: No bootstrap required, opened a new log
I20260808 02:37:28.213191 12100 tablet_bootstrap.cc:492] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: No bootstrap required, opened a new log
I20260808 02:37:28.213260 12099 ts_tablet_manager.cc:1397] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260808 02:37:28.213372 12100 ts_tablet_manager.cc:1397] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260808 02:37:28.214219 12100 raft_consensus.cc:348] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.214514 12100 raft_consensus.cc:374] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:28.214303 12099 raft_consensus.cc:348] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.214630 12100 raft_consensus.cc:729] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8399ea7c20064b4abf7ef8105fa3f2af, State: Initialized, Role: FOLLOWER
I20260808 02:37:28.214782 12099 raft_consensus.cc:374] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:28.214942 12099 raft_consensus.cc:729] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4fde726d43844dca30ea009d1fce702, State: Initialized, Role: FOLLOWER
I20260808 02:37:28.214990 12100 consensus_queue.cc:260] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.215248 12099 consensus_queue.cc:260] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.215780 12100 ts_tablet_manager.cc:1428] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:37:28.215996 12099 ts_tablet_manager.cc:1428] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 02:37:28.287029 12089 raft_consensus.cc:482] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:28.287457 12089 raft_consensus.cc:504] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.288746 12089 leader_election.cc:288] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839), 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811)
I20260808 02:37:28.289315 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "274b072e50a64bfdb3cc2d9283fda404" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" is_pre_election: true
I20260808 02:37:28.289651 11692 raft_consensus.cc:2454] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 0.
I20260808 02:37:28.289634 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "274b072e50a64bfdb3cc2d9283fda404" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" is_pre_election: true
I20260808 02:37:28.289934 11846 raft_consensus.cc:2454] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 0.
I20260808 02:37:28.290179 11915 leader_election.cc:302] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1c55c4f3b94491f8af979af83b7a2ba, f4fde726d43844dca30ea009d1fce702; no voters:
I20260808 02:37:28.290571 12089 raft_consensus.cc:2781] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:28.290771 12089 raft_consensus.cc:482] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:28.290911 12089 raft_consensus.cc:3037] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:28.293614 12089 raft_consensus.cc:504] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.294484 12089 leader_election.cc:288] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 election: Requested vote from peers e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839), 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811)
I20260808 02:37:28.295243 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "274b072e50a64bfdb3cc2d9283fda404" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c55c4f3b94491f8af979af83b7a2ba"
I20260808 02:37:28.295286 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "274b072e50a64bfdb3cc2d9283fda404" candidate_uuid: "f4fde726d43844dca30ea009d1fce702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8399ea7c20064b4abf7ef8105fa3f2af"
I20260808 02:37:28.295487 11692 raft_consensus.cc:3037] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:28.295544 11846 raft_consensus.cc:3037] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:28.298030 11692 raft_consensus.cc:2454] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 1.
I20260808 02:37:28.298727 11846 raft_consensus.cc:2454] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4fde726d43844dca30ea009d1fce702 in term 1.
I20260808 02:37:28.298748 11915 leader_election.cc:302] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1c55c4f3b94491f8af979af83b7a2ba, f4fde726d43844dca30ea009d1fce702; no voters:
I20260808 02:37:28.299149 12089 raft_consensus.cc:2781] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:28.299340 12089 raft_consensus.cc:686] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 1 LEADER]: Becoming Leader. State: Replica: f4fde726d43844dca30ea009d1fce702, State: Running, Role: LEADER
I20260808 02:37:28.299700 12089 consensus_queue.cc:237] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.303532 11525 catalog_manager.cc:5495] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4fde726d43844dca30ea009d1fce702 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "f4fde726d43844dca30ea009d1fce702" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } health_report { overall_health: HEALTHY } } }
Aug 08 02:37:28 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156645, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:28.387084 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.353773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35141 (local address 127.0.0.1:39236)
0808 02:37:28.366051 (+ 12278us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:28.366079 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:28.366272 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:28.367337 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:28.367343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:28.368651 (+ 1308us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:28.369075 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.369094 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.371034 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.371041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.372840 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.372862 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.374011 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.374020 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.374295 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.375252 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:28.375282 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:28.379042 (+ 3760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:28.383307 (+ 4265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:28.383329 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:28.383340 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:28.384140 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:28.384731 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:28.384738 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:28.384742 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:28.384941 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:28.385633 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:28.385644 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:28.385887 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 02:37:28.386129 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 02:37:28.386546 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12074,"mutex_wait_us":1,"thread_start_us":11871,"threads_started":1}
I20260808 02:37:28.387199 12109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.353849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39236 (local address 127.10.20.126:35141)
0808 02:37:28.366843 (+ 12994us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.366848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.366872 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:37:28.366922 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.366927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.366996 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.367112 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:28.369398 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.370841 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.373056 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.373770 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.373912 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.379344 (+ 5432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:28.379350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:28.379354 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:28.379395 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:28.383110 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.384335 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.384372 (+ 37us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.384375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.384547 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.385070 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.385075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.385077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.385472 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:28.385597 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.386240 (+ 643us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.386765 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":199,"server-negotiator.queue_time_us":12864,"thread_start_us":12692,"threads_started":1}
I20260808 02:37:28.394439 11525 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:39236:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 02:37:28.395815 11525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:28.404114 11819 tablet_service.cc:1467] Processing CreateTablet for tablet 4f135310daaf4d84a1f64604575a541f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=316b33a6cf8542e999ad1357e6017422]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:37:28.404036 11672 tablet_service.cc:1467] Processing CreateTablet for tablet 4f135310daaf4d84a1f64604575a541f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=316b33a6cf8542e999ad1357e6017422]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:37:28.404690 11819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f135310daaf4d84a1f64604575a541f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:28.404695 11672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f135310daaf4d84a1f64604575a541f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:28.404529 11967 tablet_service.cc:1467] Processing CreateTablet for tablet 4f135310daaf4d84a1f64604575a541f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=316b33a6cf8542e999ad1357e6017422]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:37:28.405110 11967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f135310daaf4d84a1f64604575a541f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:28.413147 12100 tablet_bootstrap.cc:492] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: Bootstrap starting.
I20260808 02:37:28.415040 12100 tablet_bootstrap.cc:654] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:28.416528 12099 tablet_bootstrap.cc:492] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: Bootstrap starting.
I20260808 02:37:28.416558 12097 tablet_bootstrap.cc:492] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: Bootstrap starting.
I20260808 02:37:28.418296 12097 tablet_bootstrap.cc:654] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:28.418730 12099 tablet_bootstrap.cc:654] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:28.420197 12100 tablet_bootstrap.cc:492] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: No bootstrap required, opened a new log
I20260808 02:37:28.420413 12100 ts_tablet_manager.cc:1397] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260808 02:37:28.421134 12100 raft_consensus.cc:348] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.421408 12100 raft_consensus.cc:374] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:28.421494 12100 raft_consensus.cc:729] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8399ea7c20064b4abf7ef8105fa3f2af, State: Initialized, Role: FOLLOWER
I20260808 02:37:28.421787 12100 consensus_queue.cc:260] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.422343 12099 tablet_bootstrap.cc:492] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: No bootstrap required, opened a new log
I20260808 02:37:28.422540 12099 ts_tablet_manager.cc:1397] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260808 02:37:28.422516 12082 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.422852 12082 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.424981 12097 tablet_bootstrap.cc:492] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: No bootstrap required, opened a new log
I20260808 02:37:28.425186 12097 ts_tablet_manager.cc:1397] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20260808 02:37:28.425845 12097 raft_consensus.cc:348] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.426079 12097 raft_consensus.cc:374] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:28.426185 12097 raft_consensus.cc:729] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c55c4f3b94491f8af979af83b7a2ba, State: Initialized, Role: FOLLOWER
I20260808 02:37:28.426434 12097 consensus_queue.cc:260] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.427040 12097 ts_tablet_manager.cc:1428] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 02:37:28.426994 12083 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.427438 12083 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.429006 12100 ts_tablet_manager.cc:1428] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260808 02:37:28.424181 12099 raft_consensus.cc:348] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.430833 12099 raft_consensus.cc:374] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:28.430984 12099 raft_consensus.cc:729] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4fde726d43844dca30ea009d1fce702, State: Initialized, Role: FOLLOWER
I20260808 02:37:28.431304 12099 consensus_queue.cc:260] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.432003 12099 ts_tablet_manager.cc:1428] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260808 02:37:28.431866 12089 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.432214 12089 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.553728 12083 raft_consensus.cc:482] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:28.553994 12083 raft_consensus.cc:504] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.555755 12083 leader_election.cc:288] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811), f4fde726d43844dca30ea009d1fce702 (127.10.20.67:46837)
I20260808 02:37:28.575631 12080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.556929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:41509 (local address 127.10.20.67:46837)
0808 02:37:28.557214 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.557224 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.568410 (+ 11186us) server_negotiation.cc:407] Connection header received
0808 02:37:28.568608 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.568616 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.568714 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.568814 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:28.569864 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.571076 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.572967 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.574352 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.574532 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.574610 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.575118 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.575267 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 02:37:28.575652 12115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.556109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:46837 (local address 127.10.20.65:41509)
0808 02:37:28.568287 (+ 12178us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:28.568303 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:28.568448 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:28.569020 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:28.569026 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:28.569066 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:28.569593 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.569610 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.571226 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.571232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.572777 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.572795 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.574749 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.574759 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.574932 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.574958 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 02:37:28.575082 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 02:37:28.575304 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12046,"thread_start_us":11360,"threads_started":1}
I20260808 02:37:28.577273 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.556018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:37811 (local address 127.10.20.65:50821)
0808 02:37:28.567845 (+ 11827us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:28.567876 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:28.568107 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:28.568678 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:28.568683 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:28.568711 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:28.569133 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.569146 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.570957 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.570964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.573744 (+ 2780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.573765 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.576152 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.576161 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.576435 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.576483 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 02:37:28.576633 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 02:37:28.576797 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11605,"mutex_wait_us":24,"thread_start_us":11938,"threads_started":1}
I20260808 02:37:28.577433 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.556450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:50821 (local address 127.10.20.66:37811)
0808 02:37:28.567133 (+ 10683us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.567144 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.568242 (+ 1098us) server_negotiation.cc:407] Connection header received
0808 02:37:28.568353 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.568359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.568483 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.568650 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:28.569409 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.570764 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.574016 (+ 3252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.575700 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.575893 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.575976 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.576808 (+ 832us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.577007 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10464,"thread_start_us":10699,"threads_started":1}
I20260808 02:37:28.577157 11993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f135310daaf4d84a1f64604575a541f" candidate_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4fde726d43844dca30ea009d1fce702" is_pre_election: true
I20260808 02:37:28.577767 11993 raft_consensus.cc:2454] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c55c4f3b94491f8af979af83b7a2ba in term 0.
I20260808 02:37:28.578372 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f135310daaf4d84a1f64604575a541f" candidate_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" is_pre_election: true
I20260808 02:37:28.578502 11622 leader_election.cc:302] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1c55c4f3b94491f8af979af83b7a2ba, f4fde726d43844dca30ea009d1fce702; no voters:
I20260808 02:37:28.578651 11846 raft_consensus.cc:2454] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c55c4f3b94491f8af979af83b7a2ba in term 0.
I20260808 02:37:28.579010 12083 raft_consensus.cc:2781] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:28.579146 12083 raft_consensus.cc:482] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:28.579286 12083 raft_consensus.cc:3037] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:28.581565 12083 raft_consensus.cc:504] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.582309 12083 leader_election.cc:288] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [CANDIDATE]: Term 1 election: Requested vote from peers 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811), f4fde726d43844dca30ea009d1fce702 (127.10.20.67:46837)
I20260808 02:37:28.582945 11993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f135310daaf4d84a1f64604575a541f" candidate_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4fde726d43844dca30ea009d1fce702"
I20260808 02:37:28.582888 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f135310daaf4d84a1f64604575a541f" candidate_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8399ea7c20064b4abf7ef8105fa3f2af"
I20260808 02:37:28.583190 11993 raft_consensus.cc:3037] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:28.583189 11846 raft_consensus.cc:3037] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:28.586030 11993 raft_consensus.cc:2454] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c55c4f3b94491f8af979af83b7a2ba in term 1.
I20260808 02:37:28.586615 11622 leader_election.cc:302] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1c55c4f3b94491f8af979af83b7a2ba, f4fde726d43844dca30ea009d1fce702; no voters:
I20260808 02:37:28.586891 11846 raft_consensus.cc:2454] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c55c4f3b94491f8af979af83b7a2ba in term 1.
I20260808 02:37:28.587064 12083 raft_consensus.cc:2781] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:28.596518 12083 raft_consensus.cc:686] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [term 1 LEADER]: Becoming Leader. State: Replica: e1c55c4f3b94491f8af979af83b7a2ba, State: Running, Role: LEADER
I20260808 02:37:28.597458 12083 consensus_queue.cc:237] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } }
I20260808 02:37:28.599975 12118 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: TxnStatusTablet state changed. Reason: New leader e1c55c4f3b94491f8af979af83b7a2ba. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.600476 12118 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:37:28.601648 12120 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 02:37:28.601980 12120 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 02:37:28.602301 11524 catalog_manager.cc:5495] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba reported cstate change: term changed from 0 to 1, leader changed from <none> to e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65). New cstate: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } health_report { overall_health: UNKNOWN } } }
I20260808 02:37:28.640410 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.624400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.10.20.65:34839)
0808 02:37:28.631445 (+ 7045us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.631453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.631508 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:37:28.631664 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.631673 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.631837 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.632121 (+ 284us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:28.632818 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.634332 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.636626 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.637548 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.637726 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.638440 (+ 714us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.639434 (+ 994us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.639705 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.639809 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.639928 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6804,"thread_start_us":6535,"threads_started":1}
I20260808 02:37:28.640390 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.624369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34839 (local address 127.0.0.1:59102)
0808 02:37:28.624684 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:28.624716 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:28.625152 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:28.632217 (+ 7065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:28.632223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:28.632243 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:28.632516 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.632532 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.634559 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.634566 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.636394 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.636420 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.637790 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.637797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.638025 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.638121 (+ 96us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.639629 (+ 1508us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.639665 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:37:28.639780 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 02:37:28.639994 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 02:37:28.648461 11846 raft_consensus.cc:1261] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Refusing update from remote peer e1c55c4f3b94491f8af979af83b7a2ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:28.648528 11993 raft_consensus.cc:1261] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Refusing update from remote peer e1c55c4f3b94491f8af979af83b7a2ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:28.649657 12118 consensus_queue.cc:1035] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:28.650307 12083 consensus_queue.cc:1035] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:28.671258 12082 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: TxnStatusTablet state changed. Reason: New leader e1c55c4f3b94491f8af979af83b7a2ba. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.671646 12082 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.670461 12089 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: TxnStatusTablet state changed. Reason: New leader e1c55c4f3b94491f8af979af83b7a2ba. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.672243 12089 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.674604 12124 mvcc.cc:205] Tried to move back new op lower bound from 7316097632852733952 to 7316097632659402752. Current Snapshot: MvccSnapshot[applied={T|T < 7316097632852733952}]
I20260808 02:37:28.688845 12082 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.689208 12082 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P 8399ea7c20064b4abf7ef8105fa3f2af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.689805 12083 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.690171 12083 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:37:28.690547 12083 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.690831 12083 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P e1c55c4f3b94491f8af979af83b7a2ba: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:37:28.695896 12089 tablet_replica.cc:439] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 } } peers { permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 } } peers { permanent_uuid: "f4fde726d43844dca30ea009d1fce702" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 46837 } } }
I20260808 02:37:28.696241 12089 tablet_replica.cc:442] T 4f135310daaf4d84a1f64604575a541f P f4fde726d43844dca30ea009d1fce702: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:28.759292 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.741586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:38767 (local address 127.10.20.65:34839)
0808 02:37:28.741795 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.741801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.751692 (+ 9891us) server_negotiation.cc:407] Connection header received
0808 02:37:28.751962 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.751968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.752069 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.752181 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:28.752914 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.754168 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.756744 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.757497 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.757685 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.758374 (+ 689us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.758522 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.758622 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.758846 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.758944 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:37:28.759615 12134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.741065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34839 (local address 127.10.20.67:38767)
0808 02:37:28.751499 (+ 10434us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:28.751529 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:28.751761 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:28.752232 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:28.752237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:28.752253 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:28.752704 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.752720 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.754383 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.754390 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.756502 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.756527 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.757772 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.757783 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.758037 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.758131 (+ 94us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.758649 (+ 518us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.758662 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 02:37:28.758801 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 02:37:28.758994 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10140,"thread_start_us":9893,"threads_started":1}
I20260808 02:37:28.776273 11846 raft_consensus.cc:1261] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Refusing update from remote peer f4fde726d43844dca30ea009d1fce702: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:28.777019 11692 raft_consensus.cc:1261] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Refusing update from remote peer f4fde726d43844dca30ea009d1fce702: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:28.776918 12072 consensus_queue.cc:1035] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8399ea7c20064b4abf7ef8105fa3f2af" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:28.777686 12072 consensus_queue.cc:1035] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c55c4f3b94491f8af979af83b7a2ba" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:28.785934 12126 mvcc.cc:205] Tried to move back new op lower bound from 7316097633377640448 to 7316097631439605760. Current Snapshot: MvccSnapshot[applied={T|T < 7316097633377640448}]
I20260808 02:37:28.830776 12140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.821816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:46837 (local address 127.10.20.65:33699)
0808 02:37:28.822651 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:28.822705 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:28.822890 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:28.823337 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:28.823342 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:28.823357 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:28.824387 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.824402 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.826087 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.826092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.828099 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:28.828121 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.829074 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.829083 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:28.829310 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.829402 (+ 92us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.829980 (+ 578us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.830001 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 02:37:28.830117 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 02:37:28.830284 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":420,"threads_started":1}
I20260808 02:37:28.830791 12080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.821839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:33699 (local address 127.10.20.67:46837)
0808 02:37:28.822061 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.822068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.822807 (+ 739us) server_negotiation.cc:407] Connection header received
0808 02:37:28.823056 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.823062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.823179 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.823295 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:28.824638 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.825920 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.828269 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.828838 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.828983 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.829665 (+ 682us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:28.829821 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:28.829919 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.830317 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.830451 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:37:28.879623 11525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:28.879914 11525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:28.883169 11525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbdadefb0c654f21a4d6f6cc584cd20e: Sending DeleteTablet for 3 replicas of tablet 274b072e50a64bfdb3cc2d9283fda404
I20260808 02:37:28.884346 11819 tablet_service.cc:1514] Processing DeleteTablet for tablet 274b072e50a64bfdb3cc2d9283fda404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:28 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:41382
I20260808 02:37:28.884429 11967 tablet_service.cc:1514] Processing DeleteTablet for tablet 274b072e50a64bfdb3cc2d9283fda404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:28 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:33932
I20260808 02:37:28.885089 11672 tablet_service.cc:1514] Processing DeleteTablet for tablet 274b072e50a64bfdb3cc2d9283fda404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:28 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:59090
I20260808 02:37:28.893487 12144 tablet_replica.cc:330] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: stopping tablet replica
I20260808 02:37:28.893857 12144 raft_consensus.cc:2229] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:28.894296 12144 raft_consensus.cc:2258] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:28.897955 12144 ts_tablet_manager.cc:1905] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:28.899217 12142 tablet_replica.cc:330] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: stopping tablet replica
I20260808 02:37:28.899480 12142 raft_consensus.cc:2229] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:28.899951 12142 raft_consensus.cc:2258] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:28.901433 12143 tablet_replica.cc:330] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: stopping tablet replica
I20260808 02:37:28.901660 12143 raft_consensus.cc:2229] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:28.903173 12143 raft_consensus.cc:2258] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:28.903604 12142 ts_tablet_manager.cc:1905] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:28.908149 12144 ts_tablet_manager.cc:1918] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:28.908314 12143 ts_tablet_manager.cc:1905] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:28.908349 12144 log.cc:1196] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/274b072e50a64bfdb3cc2d9283fda404
I20260808 02:37:28.908942 12144 ts_tablet_manager.cc:1939] T 274b072e50a64bfdb3cc2d9283fda404 P e1c55c4f3b94491f8af979af83b7a2ba: Deleting consensus metadata
I20260808 02:37:28.910343 11509 catalog_manager.cc:4841] TS e1c55c4f3b94491f8af979af83b7a2ba (127.10.20.65:34839): tablet 274b072e50a64bfdb3cc2d9283fda404 (table test-table [id=c3902b7261f34d55b3be27ee502c0787]) successfully deleted
I20260808 02:37:28.914616 12143 ts_tablet_manager.cc:1918] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:28.914930 12143 log.cc:1196] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/274b072e50a64bfdb3cc2d9283fda404
I20260808 02:37:28.915452 12143 ts_tablet_manager.cc:1939] T 274b072e50a64bfdb3cc2d9283fda404 P 8399ea7c20064b4abf7ef8105fa3f2af: Deleting consensus metadata
I20260808 02:37:28.916824 11511 catalog_manager.cc:4841] TS 8399ea7c20064b4abf7ef8105fa3f2af (127.10.20.66:37811): tablet 274b072e50a64bfdb3cc2d9283fda404 (table test-table [id=c3902b7261f34d55b3be27ee502c0787]) successfully deleted
I20260808 02:37:28.920612 12142 ts_tablet_manager.cc:1918] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:28.920878 12142 log.cc:1196] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/274b072e50a64bfdb3cc2d9283fda404
I20260808 02:37:28.921483 12142 ts_tablet_manager.cc:1939] T 274b072e50a64bfdb3cc2d9283fda404 P f4fde726d43844dca30ea009d1fce702: Deleting consensus metadata
I20260808 02:37:28.923074 11513 catalog_manager.cc:4841] TS f4fde726d43844dca30ea009d1fce702 (127.10.20.67:46837): tablet 274b072e50a64bfdb3cc2d9283fda404 (table test-table [id=c3902b7261f34d55b3be27ee502c0787]) successfully deleted
Aug 08 02:37:28 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:28.942101 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.920297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.10.20.65:34839)
0808 02:37:28.920675 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.920684 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.921604 (+ 920us) server_negotiation.cc:407] Connection header received
0808 02:37:28.921976 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.921982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.922119 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.922386 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:28.924621 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.925390 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.927092 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.927734 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.927916 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.933326 (+ 5410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:28.933346 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:28.933369 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:28.933429 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:28.938167 (+ 4738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.939237 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.939246 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.939249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.939430 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.939888 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.939892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.939894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.940298 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:28.940674 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.940986 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.941541 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260808 02:37:28.942965 11741 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59114
I20260808 02:37:28.966892 12149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.946660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.10.20.126:35141)
0808 02:37:28.947424 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.947431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.947457 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:37:28.947545 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.947550 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.947634 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.947770 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:28.949432 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.950745 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.953146 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.953888 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.954208 (+ 320us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.958017 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:28.958028 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:28.958035 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:28.958094 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:28.962273 (+ 4179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.963443 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.963449 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.963454 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.963687 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.964463 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.964468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.964472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.964949 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:28.965251 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.965813 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.966320 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":452,"threads_started":1}
W20260808 02:37:28.967677 11525 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39246
I20260808 02:37:28.971853 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11603
I20260808 02:37:28.990077 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:28.972963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59122 (local address 127.10.20.65:34839)
0808 02:37:28.973260 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:28.973269 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:28.973477 (+ 208us) server_negotiation.cc:407] Connection header received
0808 02:37:28.973739 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:28.973744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:28.973863 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:28.973979 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:28.975994 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.976792 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.978897 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:28.979424 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:28.979551 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:28.983188 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:28.983194 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:28.983197 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:28.983247 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:28.986522 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.987689 (+ 1167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.987694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.987696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.987872 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:28.988390 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:28.988394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:28.988396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:28.988745 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:28.989003 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:28.989438 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 02:37:28.989691 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 02:37:28.990940 11741 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59122
W20260808 02:37:28.991725 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11603: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:28.991989 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11603
I20260808 02:37:29.014999 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11751
Aug 08 02:37:29 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:37:29.034040 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:29.015863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41384 (local address 127.10.20.66:37811)
0808 02:37:29.016066 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:29.016070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:29.016164 (+ 94us) server_negotiation.cc:407] Connection header received
0808 02:37:29.016367 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:29.016372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:29.016472 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:29.016613 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:29.018242 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:29.019235 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:29.020769 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:29.021219 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:29.021328 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:29.027281 (+ 5953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:29.027303 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:29.027319 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:29.027376 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:29.030643 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:29.031607 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:29.031615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:29.031617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:29.031783 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:29.032259 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:29.032263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:29.032265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:29.032750 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:29.033039 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:29.033443 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 02:37:29.033653 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 02:37:29.034948 11890 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41384
W20260808 02:37:29.035723 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11751: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:29.035905 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11751
I20260808 02:37:29.057093 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11899
Aug 08 02:37:29 dist-test-slave-8tdl krb5kdc[11476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156647, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:37:29.074908 12080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:29.058023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33962 (local address 127.10.20.67:46837)
0808 02:37:29.058259 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:29.058268 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:29.058291 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:37:29.058556 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:29.058560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:29.058629 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:29.058786 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:29.060289 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:29.061014 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:29.062351 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:29.062882 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:29.063040 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:29.068022 (+ 4982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:29.068043 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:29.068059 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:29.068109 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:29.071574 (+ 3465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:29.072465 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:29.072474 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:29.072477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:29.072632 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:29.073061 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:29.073067 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:29.073070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:29.073494 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:29.073854 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:29.074245 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 02:37:29.074517 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 02:37:29.075738 12037 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33962
W20260808 02:37:29.076650 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11899: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:29.076838 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11899
I20260808 02:37:29.103313 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 11491
I20260808 02:37:29.104950 11569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:29.229393 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 11491
2026-08-08T02:37:29Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5878 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:29 dist-test-slave-8tdl krb5kdc[12155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:29 dist-test-slave-8tdl krb5kdc[12155](info): set up 2 sockets
Aug 08 02:37:29 dist-test-slave-8tdl krb5kdc[12155](info): commencing operation
krb5kdc: starting...
W20260808 02:37:30.418926 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.004s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:30 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:30.692190 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:45443
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:45443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:31.066531 12169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:31.066972 12169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:31.067133 12169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:31.075037 12169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:31.075178 12169 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 02:37:31.075249 12169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:31.075376 12169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:31.075451 12169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:31.075527 12169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:31.086117 12169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:45443
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:45443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:31.087642 12169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:31.089165 12169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:31.102501 12176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:31.102586 12180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:31.102569 12177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:31.103574 12169 server_base.cc:1034] running on GCE node
I20260808 02:37:31.104557 12169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:31.106247 12169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:31.107554 12169 hybrid_clock.cc:648] HybridClock initialized: now 1786156651107474 us; error 59 us; skew 500 ppm
I20260808 02:37:31.108000 12169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:31 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:31.117233 12169 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:31.119359 12169 webserver.cc:460] Webserver started at http://127.10.20.126:38457/ using document root <none> and password file <none>
I20260808 02:37:31.120236 12169 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:31.120404 12169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:31.120770 12169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:31.124249 12169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "b7042224a7834cc48f4b4c382492ae34"
format_stamp: "Formatted at 2026-08-08 02:37:31 on dist-test-slave-8tdl"
server_key: "300b2b8b21f4177c2dfb589c96e8091c"
server_key_iv: "88292ffd22b61e1771ce9a289d6f9b58"
server_key_version: "encryptionkey@0"
I20260808 02:37:31.125204 12169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "b7042224a7834cc48f4b4c382492ae34"
format_stamp: "Formatted at 2026-08-08 02:37:31 on dist-test-slave-8tdl"
server_key: "300b2b8b21f4177c2dfb589c96e8091c"
server_key_iv: "88292ffd22b61e1771ce9a289d6f9b58"
server_key_version: "encryptionkey@0"
I20260808 02:37:31.131685 12169 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:37:31.136526 12187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:31.138424 12169 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:31.138772 12169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "b7042224a7834cc48f4b4c382492ae34"
format_stamp: "Formatted at 2026-08-08 02:37:31 on dist-test-slave-8tdl"
server_key: "300b2b8b21f4177c2dfb589c96e8091c"
server_key_iv: "88292ffd22b61e1771ce9a289d6f9b58"
server_key_version: "encryptionkey@0"
I20260808 02:37:31.139084 12169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:31.180694 12169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:31.186173 12169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:31.186616 12169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:31.211575 12169 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:45443
I20260808 02:37:31.211598 12253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:45443 every 8 connection(s)
I20260808 02:37:31.213212 12169 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:31.217939 12254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:31.222462 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 12169
I20260808 02:37:31.222726 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:31.223724 10321 external_mini_cluster.cc:1428] Setting key 1a2101a10bde3d5607d172b6bcc22336
I20260808 02:37:31.234436 12254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Bootstrap starting.
I20260808 02:37:31.238906 12254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:31.240548 12254 log.cc:824] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:37:31 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:31.244463 12254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: No bootstrap required, opened a new log
I20260808 02:37:31.253413 12258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:31.226483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40904 (local address 127.10.20.126:45443)
0808 02:37:31.227777 (+ 1294us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:31.227790 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:31.227835 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:37:31.229625 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:31.229652 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:31.230154 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:31.230543 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:31.232649 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.234243 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.236238 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.237150 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.237328 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:31.242966 (+ 5638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:31.242975 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:31.242993 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:31.243047 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:31.247474 (+ 4427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:31.248522 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:31.248533 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:31.248544 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:31.248808 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:31.249311 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:31.249316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:31.249320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:31.250237 (+ 917us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:31.250592 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:31.251236 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 02:37:31.251805 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1024,"thread_start_us":688,"threads_started":1}
I20260808 02:37:31.255834 12254 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7042224a7834cc48f4b4c382492ae34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45443 } }
I20260808 02:37:31.256361 12254 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:31.256556 12254 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7042224a7834cc48f4b4c382492ae34, State: Initialized, Role: FOLLOWER
I20260808 02:37:31.257273 12254 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7042224a7834cc48f4b4c382492ae34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45443 } }
I20260808 02:37:31.257604 12254 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:31.257719 12254 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:31.257858 12254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:31.260257 12254 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7042224a7834cc48f4b4c382492ae34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45443 } }
I20260808 02:37:31.260800 12254 leader_election.cc:302] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7042224a7834cc48f4b4c382492ae34; no voters:
I20260808 02:37:31.261400 12254 leader_election.cc:288] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:31.261649 12260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:31.262775 12260 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [term 1 LEADER]: Becoming Leader. State: Replica: b7042224a7834cc48f4b4c382492ae34, State: Running, Role: LEADER
I20260808 02:37:31.263453 12260 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7042224a7834cc48f4b4c382492ae34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45443 } }
I20260808 02:37:31.263931 12254 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:31.266906 12262 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7042224a7834cc48f4b4c382492ae34. Latest consensus state: current_term: 1 leader_uuid: "b7042224a7834cc48f4b4c382492ae34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7042224a7834cc48f4b4c382492ae34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45443 } } }
I20260808 02:37:31.267366 12262 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:31.267884 12261 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7042224a7834cc48f4b4c382492ae34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7042224a7834cc48f4b4c382492ae34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45443 } } }
I20260808 02:37:31.268218 12261 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:31.276856 12267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:31.281821 12267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:31.292419 12267 catalog_manager.cc:1347] Generated new cluster ID: 8533404c629f4c8e87fe9fb2a46adb7f
I20260808 02:37:31.292579 12267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:31.307258 12267 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:31.308879 12267 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:31.326604 12267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Generated new TSK 0
I20260808 02:37:31.327773 12267 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:31.392184 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45443
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:31.778301 12282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:31.778621 12282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:31.778823 12282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:31.787211 12282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:31.787361 12282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:31.787536 12282 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 02:37:31.787626 12282 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:37:31.787766 12282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:31.798431 12282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:45443
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:31.799973 12282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:31.801496 12282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:31.816952 12289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:31.816927 12292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:31.817078 12290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:31.817821 12282 server_base.cc:1034] running on GCE node
I20260808 02:37:31.818538 12282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:31.819773 12282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:31.821013 12282 hybrid_clock.cc:648] HybridClock initialized: now 1786156651820936 us; error 71 us; skew 500 ppm
I20260808 02:37:31.821389 12282 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:31 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:31.825657 12282 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:31.827817 12282 webserver.cc:460] Webserver started at http://127.10.20.65:44381/ using document root <none> and password file <none>
I20260808 02:37:31.828728 12282 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:31.828915 12282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:31.829420 12282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:31.833237 12282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
format_stamp: "Formatted at 2026-08-08 02:37:31 on dist-test-slave-8tdl"
server_key: "72f5658f0bd2f29b23f852735768d92d"
server_key_iv: "abbc103831210eea27cb2eb6f2732859"
server_key_version: "encryptionkey@0"
I20260808 02:37:31.834251 12282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
format_stamp: "Formatted at 2026-08-08 02:37:31 on dist-test-slave-8tdl"
server_key: "72f5658f0bd2f29b23f852735768d92d"
server_key_iv: "abbc103831210eea27cb2eb6f2732859"
server_key_version: "encryptionkey@0"
I20260808 02:37:31.841248 12282 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:37:31.845984 12299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:31.848057 12282 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:37:31.848305 12282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
format_stamp: "Formatted at 2026-08-08 02:37:31 on dist-test-slave-8tdl"
server_key: "72f5658f0bd2f29b23f852735768d92d"
server_key_iv: "abbc103831210eea27cb2eb6f2732859"
server_key_version: "encryptionkey@0"
I20260808 02:37:31.848567 12282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:31.871543 12282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:31.877743 12282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:31.878216 12282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:31.881677 12282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:31.881870 12282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:31.882019 12282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:31.882143 12282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:37:31 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:31.913278 12309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:31.882597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:33187 (local address 127.10.20.126:45443)
0808 02:37:31.883519 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:31.883526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:31.885096 (+ 1570us) server_negotiation.cc:407] Connection header received
0808 02:37:31.888013 (+ 2917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:31.888021 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:31.888161 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:31.888271 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:31.892090 (+ 3819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.893488 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.897461 (+ 3973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.898335 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.898557 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:31.903943 (+ 5386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:31.903950 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:31.903954 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:31.903996 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:31.908360 (+ 4364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:31.909667 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:31.909676 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:31.909680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:31.909844 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:31.910479 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:31.910489 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:31.910495 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:31.910981 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:31.911186 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:31.912557 (+ 1371us) server_negotiation.cc:299] Negotiation successful
0808 02:37:31.912844 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":650,"threads_started":1}
I20260808 02:37:31.914575 12310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:31.883652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.10.20.65:33187)
0808 02:37:31.884818 (+ 1166us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:31.884910 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:31.887449 (+ 2539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:31.889084 (+ 1635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:31.889104 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:31.890280 (+ 1176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:31.891754 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:31.891788 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.893845 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.893855 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:31.897076 (+ 3221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:31.897113 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.898795 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.898806 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:31.899077 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:31.899912 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:31.899944 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:31.903565 (+ 3621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:31.908625 (+ 5060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:31.908645 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:31.908664 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:31.909478 (+ 814us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:31.909990 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:31.910003 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:31.910007 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:31.910268 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:31.911200 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:31.911217 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:31.911997 (+ 780us) client_negotiation.cc:769] Sending connection context
0808 02:37:31.912416 (+ 419us) client_negotiation.cc:240] Negotiation successful
0808 02:37:31.913126 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":502,"threads_started":1}
I20260808 02:37:31.940485 12282 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:39863
I20260808 02:37:31.940505 12428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:39863 every 8 connection(s)
I20260808 02:37:31.942399 12282 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:31.942518 12309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:31.922698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:35583 (local address 127.10.20.126:45443)
0808 02:37:31.922941 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:31.922947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:31.924227 (+ 1280us) server_negotiation.cc:407] Connection header received
0808 02:37:31.924497 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:31.924501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:31.924574 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:31.924686 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:31.926318 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.927636 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.930811 (+ 3175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.931339 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.931476 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:31.934649 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:31.934655 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:31.934659 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:31.934777 (+ 118us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:31.938865 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:31.940031 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:31.940038 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:31.940047 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:31.940219 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:31.940797 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:31.940802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:31.940804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:31.941152 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:31.941293 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:31.941870 (+ 577us) server_negotiation.cc:299] Negotiation successful
0808 02:37:31.942190 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:37:31.942790 12396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:31.923164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.10.20.65:35583)
0808 02:37:31.924087 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:31.924106 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:31.924316 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:31.924724 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:31.924729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:31.925570 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:31.926089 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:31.926111 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.927888 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.927894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:31.930503 (+ 2609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:31.930534 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:31.931613 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:31.931624 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:31.931889 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:31.932749 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:31.932786 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:31.934303 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:31.939076 (+ 4773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:31.939083 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:31.939089 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:31.939823 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:31.940371 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:31.940377 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:31.940382 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:31.940564 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:31.941302 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:31.941310 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:31.941546 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 02:37:31.941767 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 02:37:31.942214 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":450,"threads_started":1}
I20260808 02:37:31.946568 12429 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45443
I20260808 02:37:31.946887 12429 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:31.947721 12429 heartbeater.cc:511] Master 127.10.20.126:45443 requested a full tablet report, sending...
I20260808 02:37:31.950109 12205 ts_manager.cc:194] Registered new tserver with Master: 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863)
I20260808 02:37:31.951929 12205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:33187
I20260808 02:37:31.952942 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 12282
I20260808 02:37:31.953200 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:31.954257 10321 external_mini_cluster.cc:1428] Setting key 58df4fa521f8d8b109d278597d42f307
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:32.020563 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45443
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:32.396998 12433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:32.397408 12433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:32.397614 12433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:32.405311 12433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:32.405550 12433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:32.405727 12433 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 02:37:32.405829 12433 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:37:32.405952 12433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:32.418218 12433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:45443
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:32.419865 12433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:32.421412 12433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:32.437341 12439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:32.437448 12441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:32.437448 12438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:32.438108 12433 server_base.cc:1034] running on GCE node
I20260808 02:37:32.439080 12433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:32.440220 12433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:32.441470 12433 hybrid_clock.cc:648] HybridClock initialized: now 1786156652441420 us; error 39 us; skew 500 ppm
I20260808 02:37:32.441890 12433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:32 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156652, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:32.446065 12433 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:32.448335 12433 webserver.cc:460] Webserver started at http://127.10.20.66:40459/ using document root <none> and password file <none>
I20260808 02:37:32.449208 12433 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:32.449380 12433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:32.449788 12433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:32.453552 12433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "57814e95a3cd4c2ab63cd56f92928485"
format_stamp: "Formatted at 2026-08-08 02:37:32 on dist-test-slave-8tdl"
server_key: "d5e264ab0820f468ece5e108cfdc1633"
server_key_iv: "63551cb8fb1909f0069c15dbd481c2f0"
server_key_version: "encryptionkey@0"
I20260808 02:37:32.454525 12433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "57814e95a3cd4c2ab63cd56f92928485"
format_stamp: "Formatted at 2026-08-08 02:37:32 on dist-test-slave-8tdl"
server_key: "d5e264ab0820f468ece5e108cfdc1633"
server_key_iv: "63551cb8fb1909f0069c15dbd481c2f0"
server_key_version: "encryptionkey@0"
I20260808 02:37:32.461596 12433 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 02:37:32.466988 12448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:32.468752 12433 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:32.468998 12433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "57814e95a3cd4c2ab63cd56f92928485"
format_stamp: "Formatted at 2026-08-08 02:37:32 on dist-test-slave-8tdl"
server_key: "d5e264ab0820f468ece5e108cfdc1633"
server_key_iv: "63551cb8fb1909f0069c15dbd481c2f0"
server_key_version: "encryptionkey@0"
I20260808 02:37:32.469240 12433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:32.490890 12433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:32.495996 12433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:32.496368 12433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:32.499609 12433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:32.499769 12433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:32.499917 12433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:32.500008 12433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:37:32 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156652, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:32.529597 12458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:32.500518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:49655 (local address 127.10.20.126:45443)
0808 02:37:32.503363 (+ 2845us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:32.503370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:32.503398 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:37:32.505147 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:32.505155 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:32.505260 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:32.505404 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:32.508236 (+ 2832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.509279 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.513411 (+ 4132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.514144 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.514342 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:32.520601 (+ 6259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:32.520608 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:32.520611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:32.520652 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:32.523973 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:32.524987 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:32.524993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:32.524998 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:32.525168 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:32.525722 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:32.525729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:32.525734 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:32.526197 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:32.526391 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:32.529088 (+ 2697us) server_negotiation.cc:299] Negotiation successful
0808 02:37:32.529311 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2691,"thread_start_us":2576,"threads_started":1}
I20260808 02:37:32.530228 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:32.501297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.10.20.66:49655)
0808 02:37:32.502529 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:32.502612 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:32.504803 (+ 2191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:32.505794 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:32.505809 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:32.506833 (+ 1024us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:32.507968 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:32.508007 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.509546 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.509556 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:32.513012 (+ 3456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:32.513073 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.514758 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.514772 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:32.515165 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:32.516200 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:32.516230 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:32.520241 (+ 4011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:32.524216 (+ 3975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:32.524235 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:32.524253 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:32.524809 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:32.525307 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:32.525313 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:32.525316 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:32.525567 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:32.526364 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:32.526374 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:32.526901 (+ 527us) client_negotiation.cc:769] Sending connection context
0808 02:37:32.527325 (+ 424us) client_negotiation.cc:240] Negotiation successful
0808 02:37:32.528082 (+ 757us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":436,"threads_started":1}
I20260808 02:37:32.556860 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:32.538020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.10.20.66:47195)
0808 02:37:32.538659 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:32.538707 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:32.538938 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:32.539411 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:32.539420 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:32.540357 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:32.541086 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:32.541107 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.542624 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.542630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:32.544203 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:32.544223 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.545152 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.545160 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:32.545363 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:32.546202 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:32.546224 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:32.547566 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:32.552709 (+ 5143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:32.552718 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:32.552726 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:32.553299 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:32.554018 (+ 719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:32.554023 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:32.554028 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:32.554198 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:32.555216 (+ 1018us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:32.555226 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:32.555507 (+ 281us) client_negotiation.cc:769] Sending connection context
0808 02:37:32.555643 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 02:37:32.556199 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"spinlock_wait_cycles":768,"thread_start_us":439,"threads_started":1}
I20260808 02:37:32.558080 12458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:32.538171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:47195 (local address 127.10.20.126:45443)
0808 02:37:32.538438 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:32.538447 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:32.538814 (+ 367us) server_negotiation.cc:407] Connection header received
0808 02:37:32.539105 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:32.539113 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:32.539214 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:32.539330 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:32.541343 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.542421 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.544395 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:32.544932 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:32.545080 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:32.547921 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:32.547933 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:32.547941 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:32.548002 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:32.552392 (+ 4390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:32.553536 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:32.553541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:32.553545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:32.553803 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:32.554408 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:32.554417 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:32.554422 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:32.555012 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:32.557424 (+ 2412us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:32.557571 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 02:37:32.557797 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:37:32.565160 12433 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:33765
I20260808 02:37:32.565218 12576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:33765 every 8 connection(s)
I20260808 02:37:32.566632 12433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:32.569258 12577 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45443
I20260808 02:37:32.569541 12577 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:32.570278 12577 heartbeater.cc:511] Master 127.10.20.126:45443 requested a full tablet report, sending...
I20260808 02:37:32.570511 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 12433
I20260808 02:37:32.570761 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:32.571292 10321 external_mini_cluster.cc:1428] Setting key ffc84e81220ade42c6cfcb22e5f63c19
I20260808 02:37:32.571942 12205 ts_manager.cc:194] Registered new tserver with Master: 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765)
I20260808 02:37:32.573563 12205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:49655
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:32.631561 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45443
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:32.956075 12429 heartbeater.cc:503] Master 127.10.20.126:45443 was elected leader, sending a full tablet report...
W20260808 02:37:33.000910 12581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:33.001322 12581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:33.001516 12581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:33.009243 12581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:33.009447 12581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:33.009617 12581 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 02:37:33.009712 12581 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:37:33.009842 12581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:33.020725 12581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:45443
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:33.022280 12581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:33.023814 12581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:33.039459 12586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:33.039347 12589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:33.039378 12587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:33.040319 12581 server_base.cc:1034] running on GCE node
I20260808 02:37:33.041266 12581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:33.042553 12581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:33.043833 12581 hybrid_clock.cc:648] HybridClock initialized: now 1786156653043723 us; error 109 us; skew 500 ppm
I20260808 02:37:33.044291 12581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:33 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156653, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:33.048195 12581 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:33.050046 12581 webserver.cc:460] Webserver started at http://127.10.20.67:32791/ using document root <none> and password file <none>
I20260808 02:37:33.050901 12581 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:33.051067 12581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:33.051424 12581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:33.054883 12581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "2115219dfbc44859a39c084aad4ad1bb"
format_stamp: "Formatted at 2026-08-08 02:37:33 on dist-test-slave-8tdl"
server_key: "3635612561dee29807e0d63d4fb70d63"
server_key_iv: "eb57208f08b403594b10e0fe5bba520c"
server_key_version: "encryptionkey@0"
I20260808 02:37:33.055773 12581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "2115219dfbc44859a39c084aad4ad1bb"
format_stamp: "Formatted at 2026-08-08 02:37:33 on dist-test-slave-8tdl"
server_key: "3635612561dee29807e0d63d4fb70d63"
server_key_iv: "eb57208f08b403594b10e0fe5bba520c"
server_key_version: "encryptionkey@0"
I20260808 02:37:33.062044 12581 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:37:33.066473 12597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:33.068281 12581 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:33.068567 12581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "2115219dfbc44859a39c084aad4ad1bb"
format_stamp: "Formatted at 2026-08-08 02:37:33 on dist-test-slave-8tdl"
server_key: "3635612561dee29807e0d63d4fb70d63"
server_key_iv: "eb57208f08b403594b10e0fe5bba520c"
server_key_version: "encryptionkey@0"
I20260808 02:37:33.068819 12581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:33.116129 12581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:33.121363 12581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:33.121732 12581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:33.124886 12581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:33.125032 12581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:33.125191 12581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:33.125296 12581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:37:33 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156653, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:33.155263 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.126006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:59271 (local address 127.10.20.126:45443)
0808 02:37:33.126564 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.126572 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.128142 (+ 1570us) server_negotiation.cc:407] Connection header received
0808 02:37:33.131693 (+ 3551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.131702 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.131825 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.131969 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:33.135693 (+ 3724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.136835 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.140980 (+ 4145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.141631 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.141821 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.147052 (+ 5231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:33.147062 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:33.147068 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:33.147117 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:33.150415 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.152015 (+ 1600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.152021 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.152024 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.152230 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.152949 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.152955 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.152961 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.153321 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:33.153492 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.154498 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.154831 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":277,"threads_started":1}
I20260808 02:37:33.157065 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.126871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.10.20.67:59271)
0808 02:37:33.127882 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.127968 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.131220 (+ 3252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.132415 (+ 1195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.132430 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.133807 (+ 1377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:33.135369 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.135416 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.137092 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.137103 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.140637 (+ 3534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.140680 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.141982 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.142000 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.142241 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.143268 (+ 1027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:33.143318 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:33.146606 (+ 3288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:33.150619 (+ 4013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:33.150631 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:33.150663 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:33.151786 (+ 1123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:33.152410 (+ 624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:33.152418 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:33.152423 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:33.152779 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:33.153584 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:33.153592 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:33.153985 (+ 393us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.154362 (+ 377us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.155082 (+ 720us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":376,"threads_started":1}
I20260808 02:37:33.179101 12581 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:41863
I20260808 02:37:33.179101 12724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:41863 every 8 connection(s)
I20260808 02:37:33.180935 12581 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:33.181540 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.165721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:38785 (local address 127.10.20.126:45443)
0808 02:37:33.165966 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.165974 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.166124 (+ 150us) server_negotiation.cc:407] Connection header received
0808 02:37:33.166367 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.166376 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.166444 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.166555 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:33.168133 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.169092 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.170723 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.171220 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.171384 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.174491 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:33.174500 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:33.174508 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:33.174563 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:33.178253 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.179212 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.179218 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.179222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.179406 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.179921 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.179926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.179930 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.180262 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:33.180454 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.180919 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.181178 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 02:37:33.181692 12702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.165068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.10.20.67:38785)
0808 02:37:33.166001 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.166030 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.166218 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.166588 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.166593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.167414 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:33.167963 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.167976 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.169234 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.169240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.170534 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.170548 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.171480 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.171490 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.171785 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.172727 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:33.172763 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:33.174200 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:33.178419 (+ 4219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:33.178425 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:33.178429 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:33.179027 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:33.179619 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:33.179625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:33.179629 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:33.179788 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:33.180418 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:33.180423 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:33.180632 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.180792 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.181203 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":710,"threads_started":1}
I20260808 02:37:33.188971 12725 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45443
I20260808 02:37:33.189335 12725 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:33.190146 12725 heartbeater.cc:511] Master 127.10.20.126:45443 requested a full tablet report, sending...
I20260808 02:37:33.191162 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 12581
I20260808 02:37:33.191407 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:33.191968 10321 external_mini_cluster.cc:1428] Setting key 1c1f4b0f4bf4c8b22dcafc17659d2749
I20260808 02:37:33.192179 12205 ts_manager.cc:194] Registered new tserver with Master: 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863)
I20260808 02:37:33.193131 12205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:59271
I20260808 02:37:33.196226 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:37:33 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:37:33 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:33.264467 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.247783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.10.20.126:45443)
0808 02:37:33.248068 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.248077 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.248465 (+ 388us) server_negotiation.cc:407] Connection header received
0808 02:37:33.248705 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.248710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.248809 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.248931 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:33.250560 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.251425 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.252840 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.253293 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.253453 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.258105 (+ 4652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:33.258111 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:33.258114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:33.258160 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:33.261309 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.262199 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.262204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.262206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.262388 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.262957 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.262961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.262964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.263288 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:33.263532 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.263970 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.264168 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 02:37:33.269656 12205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:33.278117 12205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:33.319820 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.293689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42252 (local address 127.10.20.66:33765)
0808 02:37:33.310197 (+ 16508us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.310206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.310231 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:37:33.310317 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.310323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.310523 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.310726 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.311968 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.313528 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.316701 (+ 3173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.318370 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.318540 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.318823 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.319275 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.319486 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16337,"thread_start_us":16167,"threads_started":1}
I20260808 02:37:33.319990 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.293450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.0.0.1:42252)
0808 02:37:33.307834 (+ 14384us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.307860 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.308025 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.310968 (+ 2943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.310973 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.311033 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.311759 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.311770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.313727 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.313733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.316381 (+ 2648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.316406 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.318608 (+ 2202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.318614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.318979 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.319050 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.319208 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.319440 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14180,"mutex_wait_us":69,"spinlock_wait_cycles":4480,"thread_start_us":14275,"threads_started":1}
I20260808 02:37:33.320950 12739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.293223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:41863 (local address 127.0.0.1:51408)
0808 02:37:33.307011 (+ 13788us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.307091 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.307406 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.310714 (+ 3308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.310723 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.310759 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.311290 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.311306 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.313622 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.313631 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.317239 (+ 3608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.317265 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.319738 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.319743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.320082 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.320220 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.320310 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.320485 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13332,"mutex_wait_us":244,"thread_start_us":14886,"threads_started":1}
I20260808 02:37:33.320972 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.296873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:39863 (local address 127.0.0.1:55992)
0808 02:37:33.309806 (+ 12933us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.309831 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.309980 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.310968 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.310973 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.311013 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.311735 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.311748 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.313707 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.313712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.317278 (+ 3566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.317288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.319726 (+ 2438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.319733 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.320082 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.320357 (+ 275us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.320429 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.320552 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12797,"mutex_wait_us":706,"spinlock_wait_cycles":1792,"thread_start_us":12641,"threads_started":1}
I20260808 02:37:33.321802 12741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.293549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51408 (local address 127.10.20.67:41863)
0808 02:37:33.309406 (+ 15857us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.309418 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.309454 (+ 36us) server_negotiation.cc:407] Connection header received
0808 02:37:33.309564 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.309572 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.310434 (+ 862us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.310667 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.311518 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.313413 (+ 1895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.317550 (+ 4137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.319145 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.319295 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.319557 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.321251 (+ 1694us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.321481 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15645,"thread_start_us":16546,"threads_started":1}
I20260808 02:37:33.323246 12744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.297729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.10.20.65:39863)
0808 02:37:33.309306 (+ 11577us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.309318 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.309976 (+ 658us) server_negotiation.cc:407] Connection header received
0808 02:37:33.310135 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.310144 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.310413 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.310705 (+ 292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.311962 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.313536 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.317508 (+ 3972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.319174 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.319306 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.319521 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.320568 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.322933 (+ 2365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11409,"thread_start_us":11261,"threads_started":1}
I20260808 02:37:33.324640 12503 tablet_service.cc:1467] Processing CreateTablet for tablet 665afb2285b745e88c323429e2813d27 (DEFAULT_TABLE table=test-table [id=65250102c10d427fa457231b583a2636]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:33.324802 12651 tablet_service.cc:1467] Processing CreateTablet for tablet 665afb2285b745e88c323429e2813d27 (DEFAULT_TABLE table=test-table [id=65250102c10d427fa457231b583a2636]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:33.326071 12651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 665afb2285b745e88c323429e2813d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.326073 12503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 665afb2285b745e88c323429e2813d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.335027 12355 tablet_service.cc:1467] Processing CreateTablet for tablet 665afb2285b745e88c323429e2813d27 (DEFAULT_TABLE table=test-table [id=65250102c10d427fa457231b583a2636]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:33.336731 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 665afb2285b745e88c323429e2813d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.338882 12745 tablet_bootstrap.cc:492] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Bootstrap starting.
I20260808 02:37:33.342279 12745 tablet_bootstrap.cc:654] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.342825 12746 tablet_bootstrap.cc:492] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Bootstrap starting.
I20260808 02:37:33.345839 12745 log.cc:824] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:33.347100 12746 tablet_bootstrap.cc:654] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.348573 12746 log.cc:824] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:33.349771 12745 tablet_bootstrap.cc:492] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: No bootstrap required, opened a new log
I20260808 02:37:33.350132 12745 ts_tablet_manager.cc:1397] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260808 02:37:33.358062 12746 tablet_bootstrap.cc:492] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: No bootstrap required, opened a new log
I20260808 02:37:33.358448 12746 ts_tablet_manager.cc:1397] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.005s
I20260808 02:37:33.363679 12749 tablet_bootstrap.cc:492] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Bootstrap starting.
I20260808 02:37:33.363214 12745 raft_consensus.cc:348] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.363921 12745 raft_consensus.cc:374] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.364063 12745 raft_consensus.cc:729] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.365219 12745 consensus_queue.cc:260] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.367297 12577 heartbeater.cc:503] Master 127.10.20.126:45443 was elected leader, sending a full tablet report...
I20260808 02:37:33.368747 12745 ts_tablet_manager.cc:1428] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Time spent starting tablet: real 0.018s user 0.000s sys 0.019s
I20260808 02:37:33.369339 12749 tablet_bootstrap.cc:654] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.370826 12749 log.cc:824] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:33.372354 12746 raft_consensus.cc:348] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.373044 12746 raft_consensus.cc:374] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.373170 12746 raft_consensus.cc:729] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.374064 12746 consensus_queue.cc:260] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.374571 12749 tablet_bootstrap.cc:492] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: No bootstrap required, opened a new log
I20260808 02:37:33.374984 12749 ts_tablet_manager.cc:1397] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260808 02:37:33.375545 12725 heartbeater.cc:503] Master 127.10.20.126:45443 was elected leader, sending a full tablet report...
I20260808 02:37:33.376245 12746 ts_tablet_manager.cc:1428] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Time spent starting tablet: real 0.018s user 0.012s sys 0.005s
I20260808 02:37:33.384943 12749 raft_consensus.cc:348] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.385402 12749 raft_consensus.cc:374] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.385542 12749 raft_consensus.cc:729] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a131fb9c0849378e83b4b3dcd5f7af, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.386202 12749 consensus_queue.cc:260] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.387943 12749 ts_tablet_manager.cc:1428] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
W20260808 02:37:33.438338 12726 tablet.cc:2369] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:37:33.446190 12430 tablet.cc:2369] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:33.473660 12750 raft_consensus.cc:482] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:33.474087 12750 raft_consensus.cc:504] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.476116 12750 leader_election.cc:288] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863), 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863)
I20260808 02:37:33.485303 12744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.476944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:43745 (local address 127.10.20.65:39863)
0808 02:37:33.477177 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.477186 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.477820 (+ 634us) server_negotiation.cc:407] Connection header received
0808 02:37:33.478083 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.478089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.478179 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.478300 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.478970 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.480033 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.483204 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.484140 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.484356 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.484453 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.484867 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.485008 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:37:33.485324 12741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.476600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:53097 (local address 127.10.20.67:41863)
0808 02:37:33.476908 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.476916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.478267 (+ 1351us) server_negotiation.cc:407] Connection header received
0808 02:37:33.478592 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.478610 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.478727 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.478863 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.479374 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.480363 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.483141 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.484193 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.484433 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.484522 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.484888 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.485035 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260808 02:37:33.485512 12755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.476636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:39863 (local address 127.10.20.66:43745)
0808 02:37:33.477666 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.477684 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.477910 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.478338 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.478346 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.478376 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.478783 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.478794 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.480229 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.480233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.482923 (+ 2690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.482946 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.484439 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.484447 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.484660 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.484707 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.484831 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.484992 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"mutex_wait_us":159,"thread_start_us":663,"threads_started":1}
I20260808 02:37:33.485544 12756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.476973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:41863 (local address 127.10.20.66:53097)
0808 02:37:33.478138 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.478157 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.478316 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.478902 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.478906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.478934 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.479220 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.479228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.480486 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.480491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.482923 (+ 2432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.482946 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.484493 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.484500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.484703 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.484729 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.484857 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.485020 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1060,"mutex_wait_us":100,"thread_start_us":828,"threads_started":1}
I20260808 02:37:33.486900 12376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "665afb2285b745e88c323429e2813d27" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" is_pre_election: true
I20260808 02:37:33.487216 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "665afb2285b745e88c323429e2813d27" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2115219dfbc44859a39c084aad4ad1bb" is_pre_election: true
I20260808 02:37:33.487439 12376 raft_consensus.cc:2454] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 0.
I20260808 02:37:33.487803 12673 raft_consensus.cc:2454] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 0.
I20260808 02:37:33.488323 12450 leader_election.cc:302] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 57814e95a3cd4c2ab63cd56f92928485; no voters:
I20260808 02:37:33.488839 12750 raft_consensus.cc:2781] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:33.489032 12750 raft_consensus.cc:482] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:33.489147 12750 raft_consensus.cc:3037] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.491575 12750 raft_consensus.cc:504] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.492245 12750 leader_election.cc:288] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 election: Requested vote from peers 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863), 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863)
I20260808 02:37:33.492825 12376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "665afb2285b745e88c323429e2813d27" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
I20260808 02:37:33.492827 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "665afb2285b745e88c323429e2813d27" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2115219dfbc44859a39c084aad4ad1bb"
I20260808 02:37:33.493078 12673 raft_consensus.cc:3037] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.493059 12376 raft_consensus.cc:3037] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.495599 12376 raft_consensus.cc:2454] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 1.
I20260808 02:37:33.495604 12673 raft_consensus.cc:2454] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 1.
I20260808 02:37:33.496140 12450 leader_election.cc:302] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 57814e95a3cd4c2ab63cd56f92928485; no voters:
I20260808 02:37:33.496542 12750 raft_consensus.cc:2781] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:33.497042 12750 raft_consensus.cc:686] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 LEADER]: Becoming Leader. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Running, Role: LEADER
I20260808 02:37:33.497673 12750 consensus_queue.cc:237] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } }
I20260808 02:37:33.503382 12205 catalog_manager.cc:5495] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66). New cstate: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } health_report { overall_health: UNKNOWN } } }
Aug 08 02:37:33 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
W20260808 02:37:33.569177 12578 tablet.cc:2369] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:33.570189 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.553869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40920 (local address 127.10.20.126:45443)
0808 02:37:33.554289 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.554299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.554835 (+ 536us) server_negotiation.cc:407] Connection header received
0808 02:37:33.555094 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.555097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.555156 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.555262 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:33.556558 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.557345 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.558694 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.559190 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.559366 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.563393 (+ 4027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:33.563399 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:33.563402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:33.563438 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:33.566966 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.567773 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.567803 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.567806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.567981 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:33.568389 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:33.568394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:33.568398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:33.568830 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:33.568998 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.569617 (+ 619us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.569813 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260808 02:37:33.570250 12764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.553976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45443 (local address 127.0.0.1:40920)
0808 02:37:33.554662 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.554708 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.554924 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.555297 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.555302 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.556074 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:33.556387 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.556398 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.557491 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.557498 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.558521 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.558536 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.559415 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.559421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.559604 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.560388 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:33.560407 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:33.563172 (+ 2765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:33.567122 (+ 3950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:33.567141 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:33.567156 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:33.567631 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:33.568097 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:33.568103 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:33.568106 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:33.568267 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:33.569007 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:33.569018 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:33.569199 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.569375 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.569712 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":379,"threads_started":1}
I20260808 02:37:33.577004 12205 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:40920:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 02:37:33.578141 12205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:33.586656 12355 tablet_service.cc:1467] Processing CreateTablet for tablet 5b3a58360e35461a99f0fadaa4d4531f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebd77afe7a0c48a4a503547a01ca6145]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:37:33.586875 12651 tablet_service.cc:1467] Processing CreateTablet for tablet 5b3a58360e35461a99f0fadaa4d4531f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebd77afe7a0c48a4a503547a01ca6145]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:37:33.586656 12503 tablet_service.cc:1467] Processing CreateTablet for tablet 5b3a58360e35461a99f0fadaa4d4531f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ebd77afe7a0c48a4a503547a01ca6145]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:37:33.587759 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b3a58360e35461a99f0fadaa4d4531f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.587764 12651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b3a58360e35461a99f0fadaa4d4531f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.587764 12503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b3a58360e35461a99f0fadaa4d4531f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.593945 12749 tablet_bootstrap.cc:492] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: Bootstrap starting.
I20260808 02:37:33.595781 12746 tablet_bootstrap.cc:492] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: Bootstrap starting.
I20260808 02:37:33.595850 12745 tablet_bootstrap.cc:492] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: Bootstrap starting.
I20260808 02:37:33.595955 12749 tablet_bootstrap.cc:654] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.597649 12745 tablet_bootstrap.cc:654] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.597838 12746 tablet_bootstrap.cc:654] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.600716 12749 tablet_bootstrap.cc:492] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: No bootstrap required, opened a new log
I20260808 02:37:33.600824 12745 tablet_bootstrap.cc:492] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: No bootstrap required, opened a new log
I20260808 02:37:33.600819 12746 tablet_bootstrap.cc:492] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: No bootstrap required, opened a new log
I20260808 02:37:33.600896 12749 ts_tablet_manager.cc:1397] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260808 02:37:33.600975 12746 ts_tablet_manager.cc:1397] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260808 02:37:33.600975 12745 ts_tablet_manager.cc:1397] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 02:37:33.601804 12749 raft_consensus.cc:348] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.601807 12746 raft_consensus.cc:348] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.601804 12745 raft_consensus.cc:348] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.602027 12749 raft_consensus.cc:374] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.602072 12746 raft_consensus.cc:374] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.602077 12745 raft_consensus.cc:374] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.602097 12749 raft_consensus.cc:729] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a131fb9c0849378e83b4b3dcd5f7af, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.602172 12746 raft_consensus.cc:729] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.602171 12745 raft_consensus.cc:729] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.602367 12749 consensus_queue.cc:260] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.602411 12745 consensus_queue.cc:260] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.602425 12746 consensus_queue.cc:260] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.603047 12746 ts_tablet_manager.cc:1428] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:37:33.603056 12745 ts_tablet_manager.cc:1428] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:37:33.602886 12753 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.603268 12753 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.603623 12752 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.603994 12752 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.604445 12750 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.604800 12750 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.605325 12749 ts_tablet_manager.cc:1428] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 02:37:33.625917 12750 raft_consensus.cc:482] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:33.626220 12750 raft_consensus.cc:504] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.627265 12750 leader_election.cc:288] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863), 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863)
I20260808 02:37:33.627889 12376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b3a58360e35461a99f0fadaa4d4531f" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" is_pre_election: true
I20260808 02:37:33.628034 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b3a58360e35461a99f0fadaa4d4531f" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2115219dfbc44859a39c084aad4ad1bb" is_pre_election: true
I20260808 02:37:33.628189 12376 raft_consensus.cc:2454] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 0.
I20260808 02:37:33.628386 12673 raft_consensus.cc:2454] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 0.
I20260808 02:37:33.628748 12450 leader_election.cc:302] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 57814e95a3cd4c2ab63cd56f92928485; no voters:
I20260808 02:37:33.629091 12750 raft_consensus.cc:2781] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:33.629179 12750 raft_consensus.cc:482] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:33.629303 12750 raft_consensus.cc:3037] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.631585 12750 raft_consensus.cc:504] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.632278 12750 leader_election.cc:288] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 election: Requested vote from peers 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863), 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863)
I20260808 02:37:33.632962 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b3a58360e35461a99f0fadaa4d4531f" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2115219dfbc44859a39c084aad4ad1bb"
I20260808 02:37:33.633019 12376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b3a58360e35461a99f0fadaa4d4531f" candidate_uuid: "57814e95a3cd4c2ab63cd56f92928485" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
I20260808 02:37:33.633277 12673 raft_consensus.cc:3037] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.633301 12376 raft_consensus.cc:3037] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.636586 12376 raft_consensus.cc:2454] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 1.
I20260808 02:37:33.636586 12673 raft_consensus.cc:2454] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57814e95a3cd4c2ab63cd56f92928485 in term 1.
I20260808 02:37:33.637099 12452 leader_election.cc:302] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2115219dfbc44859a39c084aad4ad1bb, 57814e95a3cd4c2ab63cd56f92928485; no voters:
I20260808 02:37:33.637457 12750 raft_consensus.cc:2781] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:33.637682 12750 raft_consensus.cc:686] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [term 1 LEADER]: Becoming Leader. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Running, Role: LEADER
I20260808 02:37:33.637970 12750 consensus_queue.cc:237] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.640022 12757 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: TxnStatusTablet state changed. Reason: New leader 57814e95a3cd4c2ab63cd56f92928485. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.640450 12757 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:37:33.641441 12769 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 02:37:33.641743 12769 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 02:37:33.642210 12204 catalog_manager.cc:5495] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66). New cstate: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } health_report { overall_health: UNKNOWN } } }
I20260808 02:37:33.664870 12764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.656946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.0.0.1:42264)
0808 02:37:33.657220 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.657248 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.657381 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.658087 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.658090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.658128 (+ 38us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:33.658364 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.658380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.660064 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.660069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.661427 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.661444 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.662535 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.662540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.662791 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.662979 (+ 188us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:33.664126 (+ 1147us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:33.664154 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.664281 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.664490 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 02:37:33.664844 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.656973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42264 (local address 127.10.20.66:33765)
0808 02:37:33.657210 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.657217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.657332 (+ 115us) server_negotiation.cc:407] Connection header received
0808 02:37:33.657669 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.657677 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.657827 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.658004 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:33.658546 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.659855 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.661611 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.662333 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.662472 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.663248 (+ 776us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:33.663989 (+ 741us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:33.664155 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.664377 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.664484 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:37:33.675001 12673 raft_consensus.cc:1261] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Refusing update from remote peer 57814e95a3cd4c2ab63cd56f92928485: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:33.675045 12376 raft_consensus.cc:1261] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Refusing update from remote peer 57814e95a3cd4c2ab63cd56f92928485: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:33.676141 12750 consensus_queue.cc:1035] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:33.676523 12757 consensus_queue.cc:1035] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:33.685633 12752 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: TxnStatusTablet state changed. Reason: New leader 57814e95a3cd4c2ab63cd56f92928485. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.685958 12752 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.691259 12772 mvcc.cc:205] Tried to move back new op lower bound from 7316097653440987136 to 7316097653303877632. Current Snapshot: MvccSnapshot[applied={T|T < 7316097653440987136}]
I20260808 02:37:33.691782 12750 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.692180 12750 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:37:33.695070 12753 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: TxnStatusTablet state changed. Reason: New leader 57814e95a3cd4c2ab63cd56f92928485. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.695514 12753 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.700042 12750 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.700388 12750 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 57814e95a3cd4c2ab63cd56f92928485: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:37:33.701239 12752 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.701527 12752 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 2115219dfbc44859a39c084aad4ad1bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.703867 12774 mvcc.cc:205] Tried to move back new op lower bound from 7316097653440987136 to 7316097653303877632. Current Snapshot: MvccSnapshot[applied={T|T < 7316097653440987136}]
I20260808 02:37:33.711489 12753 tablet_replica.cc:439] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57814e95a3cd4c2ab63cd56f92928485" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } } }
I20260808 02:37:33.711885 12753 tablet_replica.cc:442] T 5b3a58360e35461a99f0fadaa4d4531f P 08a131fb9c0849378e83b4b3dcd5f7af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:37:33.727090 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.717486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42278 (local address 127.10.20.66:33765)
0808 02:37:33.717704 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.717713 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.717831 (+ 118us) server_negotiation.cc:407] Connection header received
0808 02:37:33.718068 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.718074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.718174 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.718289 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:33.718777 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.720061 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.723170 (+ 3109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.724638 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.725032 (+ 394us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.725745 (+ 713us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:33.725948 (+ 203us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:33.726071 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.726265 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.726530 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:37:33.751114 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.742978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:39505 (local address 127.10.20.66:33765)
0808 02:37:33.743312 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.743324 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.744125 (+ 801us) server_negotiation.cc:407] Connection header received
0808 02:37:33.744358 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.744362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.744563 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.744656 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:33.745436 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.746368 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.748778 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.749380 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.749510 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.750253 (+ 743us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:33.750399 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:33.750508 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.750746 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.750834 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":71}
I20260808 02:37:33.751441 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.743004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.10.20.66:39505)
0808 02:37:33.743984 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.744006 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.744206 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.744698 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.744703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.744718 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:33.745236 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.745250 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.746529 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.746535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.748569 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.748590 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.749626 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.749633 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.749871 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.749968 (+ 97us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:33.750530 (+ 562us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:33.750552 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.750647 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.750862 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":25,"thread_start_us":528,"threads_started":1}
I20260808 02:37:33.766016 12376 raft_consensus.cc:1261] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Refusing update from remote peer 57814e95a3cd4c2ab63cd56f92928485: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:33.766917 12673 raft_consensus.cc:1261] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Refusing update from remote peer 57814e95a3cd4c2ab63cd56f92928485: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:33.766943 12750 consensus_queue.cc:1035] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:33.767599 12757 consensus_queue.cc:1035] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:33.854064 12204 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:33.854420 12204 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:33.859354 12204 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Sending DeleteTablet for 3 replicas of tablet 665afb2285b745e88c323429e2813d27
I20260808 02:37:33.860816 12651 tablet_service.cc:1514] Processing DeleteTablet for tablet 665afb2285b745e88c323429e2813d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:33 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:51408
I20260808 02:37:33.861511 12355 tablet_service.cc:1514] Processing DeleteTablet for tablet 665afb2285b745e88c323429e2813d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:33 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:55992
I20260808 02:37:33.861599 12501 tablet_service.cc:1514] Processing DeleteTablet for tablet 665afb2285b745e88c323429e2813d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:33 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:42252
I20260808 02:37:33.867148 12204 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:33.869736 12204 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:33.872166 12791 tablet_replica.cc:330] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: stopping tablet replica
I20260808 02:37:33.872731 12791 raft_consensus.cc:2229] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:33.874552 12791 raft_consensus.cc:2258] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:33.874419 12790 tablet_replica.cc:330] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: stopping tablet replica
I20260808 02:37:33.875236 12790 raft_consensus.cc:2229] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:33.875638 12790 raft_consensus.cc:2258] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:33.877720 12790 ts_tablet_manager.cc:1905] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:33.877740 12791 ts_tablet_manager.cc:1905] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:33.881999 12651 tablet_service.cc:1467] Processing CreateTablet for tablet 9d7758c98881468c8bea93d4771c7ee8 (DEFAULT_TABLE table=test-table [id=a9ac27e3e5e2490dae74cc53df0fe801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:33.882344 12503 tablet_service.cc:1467] Processing CreateTablet for tablet 9d7758c98881468c8bea93d4771c7ee8 (DEFAULT_TABLE table=test-table [id=a9ac27e3e5e2490dae74cc53df0fe801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:33.882561 12651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d7758c98881468c8bea93d4771c7ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.882864 12503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d7758c98881468c8bea93d4771c7ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.884714 12792 tablet_replica.cc:330] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: stopping tablet replica
I20260808 02:37:33.886893 12792 raft_consensus.cc:2229] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:33.887185 12355 tablet_service.cc:1467] Processing CreateTablet for tablet 9d7758c98881468c8bea93d4771c7ee8 (DEFAULT_TABLE table=test-table [id=a9ac27e3e5e2490dae74cc53df0fe801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:33.887854 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d7758c98881468c8bea93d4771c7ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:33.888114 12792 raft_consensus.cc:2258] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:33.890249 12746 tablet_bootstrap.cc:492] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Bootstrap starting.
I20260808 02:37:33.892416 12746 tablet_bootstrap.cc:654] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.895253 12792 ts_tablet_manager.cc:1905] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:33.897176 12745 tablet_bootstrap.cc:492] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Bootstrap starting.
I20260808 02:37:33.900674 12745 tablet_bootstrap.cc:654] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.901312 12790 ts_tablet_manager.cc:1918] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:33.901536 12790 log.cc:1196] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/665afb2285b745e88c323429e2813d27
I20260808 02:37:33.902153 12790 ts_tablet_manager.cc:1939] T 665afb2285b745e88c323429e2813d27 P 2115219dfbc44859a39c084aad4ad1bb: Deleting consensus metadata
I20260808 02:37:33.908835 12746 tablet_bootstrap.cc:492] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: No bootstrap required, opened a new log
I20260808 02:37:33.909052 12746 ts_tablet_manager.cc:1397] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.007s
I20260808 02:37:33.909940 12746 raft_consensus.cc:348] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.910238 12746 raft_consensus.cc:374] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.910321 12746 raft_consensus.cc:729] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.910631 12749 tablet_bootstrap.cc:492] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Bootstrap starting.
I20260808 02:37:33.910722 12746 consensus_queue.cc:260] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.912030 12746 ts_tablet_manager.cc:1428] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:37:33.912667 12749 tablet_bootstrap.cc:654] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:33.913940 12191 catalog_manager.cc:4841] TS 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863): tablet 665afb2285b745e88c323429e2813d27 (table test-table [id=65250102c10d427fa457231b583a2636]) successfully deleted
I20260808 02:37:33.916631 12792 ts_tablet_manager.cc:1918] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:33.916958 12792 log.cc:1196] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/665afb2285b745e88c323429e2813d27
I20260808 02:37:33.917663 12792 ts_tablet_manager.cc:1939] T 665afb2285b745e88c323429e2813d27 P 57814e95a3cd4c2ab63cd56f92928485: Deleting consensus metadata
I20260808 02:37:33.919812 12188 catalog_manager.cc:4841] TS 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765): tablet 665afb2285b745e88c323429e2813d27 (table test-table [id=65250102c10d427fa457231b583a2636]) successfully deleted
I20260808 02:37:33.920677 12749 tablet_bootstrap.cc:492] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: No bootstrap required, opened a new log
I20260808 02:37:33.920885 12749 ts_tablet_manager.cc:1397] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260808 02:37:33.921669 12749 raft_consensus.cc:348] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.921958 12749 raft_consensus.cc:374] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.922051 12749 raft_consensus.cc:729] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a131fb9c0849378e83b4b3dcd5f7af, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.922325 12749 consensus_queue.cc:260] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.923102 12749 ts_tablet_manager.cc:1428] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 02:37:33.924698 12745 tablet_bootstrap.cc:492] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: No bootstrap required, opened a new log
I20260808 02:37:33.924901 12745 ts_tablet_manager.cc:1397] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.006s
I20260808 02:37:33.925781 12745 raft_consensus.cc:348] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.926059 12745 raft_consensus.cc:374] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:33.926144 12745 raft_consensus.cc:729] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Initialized, Role: FOLLOWER
I20260808 02:37:33.926440 12745 consensus_queue.cc:260] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.927881 12745 ts_tablet_manager.cc:1428] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:37:33.929122 12791 ts_tablet_manager.cc:1918] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:33.929320 12791 log.cc:1196] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/665afb2285b745e88c323429e2813d27
I20260808 02:37:33.929843 12791 ts_tablet_manager.cc:1939] T 665afb2285b745e88c323429e2813d27 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting consensus metadata
I20260808 02:37:33.931928 12189 catalog_manager.cc:4841] TS 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863): tablet 665afb2285b745e88c323429e2813d27 (table test-table [id=65250102c10d427fa457231b583a2636]) successfully deleted
I20260808 02:37:33.934002 12752 raft_consensus.cc:482] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:33.934242 12752 raft_consensus.cc:504] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.936350 12752 leader_election.cc:288] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863), 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765)
I20260808 02:37:33.946391 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.937356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:35155 (local address 127.10.20.66:33765)
0808 02:37:33.937544 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.937551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.938229 (+ 678us) server_negotiation.cc:407] Connection header received
0808 02:37:33.938497 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.938504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.938596 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.938744 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.939607 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.940653 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.943483 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.944993 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.945140 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.945221 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.945882 (+ 661us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.946058 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 02:37:33.946810 12744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.937159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:41129 (local address 127.10.20.65:39863)
0808 02:37:33.937328 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:33.937335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:33.939075 (+ 1740us) server_negotiation.cc:407] Connection header received
0808 02:37:33.939321 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:33.939326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:33.939388 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:33.939513 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:33.940139 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.941295 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.944048 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.945424 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.945587 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.945659 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:33.946334 (+ 675us) server_negotiation.cc:299] Negotiation successful
0808 02:37:33.946486 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 02:37:33.947373 12797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.936784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.10.20.67:35155)
0808 02:37:33.938060 (+ 1276us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.938089 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.938300 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.938952 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.938958 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.938988 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.939363 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.939376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.940859 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.940864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.943254 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.943278 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.945464 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.945472 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.945665 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.945704 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.946758 (+ 1054us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.946929 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1006,"mutex_wait_us":1,"spinlock_wait_cycles":37504,"thread_start_us":1817,"threads_started":1}
I20260808 02:37:33.948115 12796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.936835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:39863 (local address 127.10.20.67:41129)
0808 02:37:33.938958 (+ 2123us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:33.938978 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:33.939170 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:33.939528 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:33.939532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:33.939556 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:33.939926 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.939953 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.941481 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.941489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.943774 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:33.943791 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:33.945953 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:33.945959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:33.946146 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:33.946180 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:37:33.947365 (+ 1185us) client_negotiation.cc:240] Negotiation successful
0808 02:37:33.947689 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1999,"spinlock_wait_cycles":896,"thread_start_us":736,"threads_started":1}
I20260808 02:37:33.948451 12528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7758c98881468c8bea93d4771c7ee8" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57814e95a3cd4c2ab63cd56f92928485" is_pre_election: true
I20260808 02:37:33.948980 12528 raft_consensus.cc:2454] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 0.
I20260808 02:37:33.949584 12375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7758c98881468c8bea93d4771c7ee8" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" is_pre_election: true
I20260808 02:37:33.949782 12598 leader_election.cc:302] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2115219dfbc44859a39c084aad4ad1bb, 57814e95a3cd4c2ab63cd56f92928485; no voters:
I20260808 02:37:33.949889 12375 raft_consensus.cc:2454] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 0.
I20260808 02:37:33.950265 12752 raft_consensus.cc:2781] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:33.950392 12752 raft_consensus.cc:482] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:33.950489 12752 raft_consensus.cc:3037] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.953747 12752 raft_consensus.cc:504] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.954476 12752 leader_election.cc:288] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 election: Requested vote from peers 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863), 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765)
I20260808 02:37:33.955123 12375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7758c98881468c8bea93d4771c7ee8" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
I20260808 02:37:33.955372 12375 raft_consensus.cc:3037] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.958825 12375 raft_consensus.cc:2454] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 1.
I20260808 02:37:33.959008 12528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7758c98881468c8bea93d4771c7ee8" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57814e95a3cd4c2ab63cd56f92928485"
I20260808 02:37:33.959280 12528 raft_consensus.cc:3037] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:33.959405 12600 leader_election.cc:302] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 2115219dfbc44859a39c084aad4ad1bb; no voters:
I20260808 02:37:33.959801 12752 raft_consensus.cc:2781] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:33.963332 12528 raft_consensus.cc:2454] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 1.
I20260808 02:37:33.964609 12752 raft_consensus.cc:686] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 1 LEADER]: Becoming Leader. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Running, Role: LEADER
I20260808 02:37:33.965430 12752 consensus_queue.cc:237] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:33.970041 12204 catalog_manager.cc:5495] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67). New cstate: current_term: 1 leader_uuid: "2115219dfbc44859a39c084aad4ad1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } health_report { overall_health: HEALTHY } } }
I20260808 02:37:34.019106 12801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:33.996842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51422 (local address 127.10.20.67:41863)
0808 02:37:34.011934 (+ 15092us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:34.011940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:34.011966 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:37:34.012083 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:34.012087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:34.012179 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:34.012371 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:34.013115 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.014082 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.016216 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.016678 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.016788 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:34.017453 (+ 665us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:34.018226 (+ 773us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:34.018337 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:34.018538 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 02:37:34.018631 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14953,"thread_start_us":15621,"threads_started":1}
I20260808 02:37:34.040621 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:34.033020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.10.20.67:36511)
0808 02:37:34.033863 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:34.033886 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:34.034069 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:34.034631 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:34.034639 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:34.034663 (+ 24us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:34.035115 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:34.035128 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.036733 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.036738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:34.038075 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:34.038092 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.039328 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.039333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:34.039484 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:34.039572 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:34.040081 (+ 509us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:34.040091 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:37:34.040159 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 02:37:34.040285 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":371,"threads_started":1}
I20260808 02:37:34.040697 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:34.032985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:36511 (local address 127.10.20.66:33765)
0808 02:37:34.033219 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:34.033225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:34.034021 (+ 796us) server_negotiation.cc:407] Connection header received
0808 02:37:34.034230 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:34.034237 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:34.034348 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:34.034474 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:34.035315 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.036533 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.038268 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.039098 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.039251 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:34.039782 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:34.039953 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:34.040055 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:34.040226 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 02:37:34.040321 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 02:37:34.051077 12375 raft_consensus.cc:1261] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Refusing update from remote peer 2115219dfbc44859a39c084aad4ad1bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:34.051385 12528 raft_consensus.cc:1261] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Refusing update from remote peer 2115219dfbc44859a39c084aad4ad1bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:34.051767 12798 consensus_queue.cc:1035] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:34.052186 12752 consensus_queue.cc:1035] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:34.091105 12801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:34.080703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:44337 (local address 127.10.20.67:41863)
0808 02:37:34.081054 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:34.081063 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:34.081092 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:37:34.081183 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:34.081190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:34.081312 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:34.081481 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:34.083221 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.084297 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.088317 (+ 4020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.088978 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.089144 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:34.089849 (+ 705us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:34.089991 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:34.090089 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:34.090668 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 02:37:34.090799 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:37:34.091917 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:34.080237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:41863 (local address 127.10.20.66:44337)
0808 02:37:34.080494 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:34.080686 (+ 192us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:34.080853 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:34.082583 (+ 1730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:34.082592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:34.082615 (+ 23us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:34.083012 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:34.083029 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.086252 (+ 3223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.086258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:34.087919 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:34.087940 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:34.089429 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:34.089435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:34.089606 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:34.089652 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:34.090129 (+ 477us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:34.090143 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 02:37:34.090261 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 02:37:34.090430 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
W20260808 02:37:34.094027 12773 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 02:37:35.714519 12204 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:35.714995 12204 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:35.720201 12204 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Sending DeleteTablet for 3 replicas of tablet 9d7758c98881468c8bea93d4771c7ee8
I20260808 02:37:35.721437 12651 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d7758c98881468c8bea93d4771c7ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:35 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:51408
I20260808 02:37:35.721441 12501 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d7758c98881468c8bea93d4771c7ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:35 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:42252
I20260808 02:37:35.721637 12355 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d7758c98881468c8bea93d4771c7ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:35 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:55992
I20260808 02:37:35.726406 12834 tablet_replica.cc:330] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: stopping tablet replica
I20260808 02:37:35.729241 12834 raft_consensus.cc:2229] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:35.729992 12834 raft_consensus.cc:2258] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:35.731328 12834 ts_tablet_manager.cc:1905] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:35.740180 12834 ts_tablet_manager.cc:1918] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:37:35.740805 12836 tablet_replica.cc:330] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: stopping tablet replica
I20260808 02:37:35.741071 12836 raft_consensus.cc:2229] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:35.741364 12836 raft_consensus.cc:2258] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:35.742019 12834 log.cc:1196] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/9d7758c98881468c8bea93d4771c7ee8
I20260808 02:37:35.742089 12835 tablet_replica.cc:330] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: stopping tablet replica
I20260808 02:37:35.742324 12835 raft_consensus.cc:2229] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:35.742626 12835 raft_consensus.cc:2258] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:35.742720 12834 ts_tablet_manager.cc:1939] T 9d7758c98881468c8bea93d4771c7ee8 P 2115219dfbc44859a39c084aad4ad1bb: Deleting consensus metadata
I20260808 02:37:35.743784 12836 ts_tablet_manager.cc:1905] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:35.743911 12835 ts_tablet_manager.cc:1905] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:35.744413 12191 catalog_manager.cc:4841] TS 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863): tablet 9d7758c98881468c8bea93d4771c7ee8 (table test-table [id=a9ac27e3e5e2490dae74cc53df0fe801]) successfully deleted
I20260808 02:37:35.749614 12836 ts_tablet_manager.cc:1918] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:37:35.749825 12836 log.cc:1196] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/9d7758c98881468c8bea93d4771c7ee8
I20260808 02:37:35.750276 12836 ts_tablet_manager.cc:1939] T 9d7758c98881468c8bea93d4771c7ee8 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting consensus metadata
I20260808 02:37:35.751552 12189 catalog_manager.cc:4841] TS 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863): tablet 9d7758c98881468c8bea93d4771c7ee8 (table test-table [id=a9ac27e3e5e2490dae74cc53df0fe801]) successfully deleted
I20260808 02:37:35.752709 12835 ts_tablet_manager.cc:1918] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:37:35.752924 12835 log.cc:1196] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/9d7758c98881468c8bea93d4771c7ee8
I20260808 02:37:35.753558 12835 ts_tablet_manager.cc:1939] T 9d7758c98881468c8bea93d4771c7ee8 P 57814e95a3cd4c2ab63cd56f92928485: Deleting consensus metadata
I20260808 02:37:35.755457 12188 catalog_manager.cc:4841] TS 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765): tablet 9d7758c98881468c8bea93d4771c7ee8 (table test-table [id=a9ac27e3e5e2490dae74cc53df0fe801]) successfully deleted
Aug 08 02:37:35 dist-test-slave-8tdl krb5kdc[12155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156655, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:37:35 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156655, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:35.805920 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:35.786965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.10.20.126:45443)
0808 02:37:35.787705 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:35.787711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:35.787740 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:37:35.787941 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:35.787945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:35.788016 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:35.788145 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:35.789892 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:35.791024 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:35.792674 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:35.793188 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:35.793363 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:35.798823 (+ 5460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:35.798830 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:35.798833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:35.798882 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:35.802849 (+ 3967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:35.803668 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:35.803680 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:35.803684 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:35.803848 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:35.804263 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:35.804268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:35.804273 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:35.804598 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:35.804866 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:35.805224 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 02:37:35.805501 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":358,"threads_started":1}
I20260808 02:37:35.811491 12204 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:35.812294 12204 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:35.820655 12355 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4413db80a342b199ff0f1f8bb3b337 (DEFAULT_TABLE table=test-table [id=5e1722ac49b1448aa7025c58f07ac78b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:35.820935 12501 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4413db80a342b199ff0f1f8bb3b337 (DEFAULT_TABLE table=test-table [id=5e1722ac49b1448aa7025c58f07ac78b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:35.821249 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4413db80a342b199ff0f1f8bb3b337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:35.821409 12501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4413db80a342b199ff0f1f8bb3b337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:35.821375 12651 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4413db80a342b199ff0f1f8bb3b337 (DEFAULT_TABLE table=test-table [id=5e1722ac49b1448aa7025c58f07ac78b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:35.821823 12651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4413db80a342b199ff0f1f8bb3b337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:35.828682 12845 tablet_bootstrap.cc:492] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Bootstrap starting.
I20260808 02:37:35.829591 12846 tablet_bootstrap.cc:492] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Bootstrap starting.
I20260808 02:37:35.831530 12845 tablet_bootstrap.cc:654] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:35.831717 12846 tablet_bootstrap.cc:654] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:35.834000 12847 tablet_bootstrap.cc:492] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Bootstrap starting.
I20260808 02:37:35.834944 12845 tablet_bootstrap.cc:492] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: No bootstrap required, opened a new log
I20260808 02:37:35.835134 12845 ts_tablet_manager.cc:1397] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 02:37:35.835587 12846 tablet_bootstrap.cc:492] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: No bootstrap required, opened a new log
I20260808 02:37:35.835891 12846 ts_tablet_manager.cc:1397] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 02:37:35.836186 12845 raft_consensus.cc:348] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:35.836457 12845 raft_consensus.cc:374] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:35.836575 12845 raft_consensus.cc:729] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a131fb9c0849378e83b4b3dcd5f7af, State: Initialized, Role: FOLLOWER
I20260808 02:37:35.836755 12847 tablet_bootstrap.cc:654] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:35.836894 12845 consensus_queue.cc:260] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:35.836861 12846 raft_consensus.cc:348] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:35.837131 12846 raft_consensus.cc:374] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:35.837244 12846 raft_consensus.cc:729] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Initialized, Role: FOLLOWER
I20260808 02:37:35.837608 12846 consensus_queue.cc:260] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:35.838294 12845 ts_tablet_manager.cc:1428] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:37:35.838580 12846 ts_tablet_manager.cc:1428] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:37:35.842586 12847 tablet_bootstrap.cc:492] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: No bootstrap required, opened a new log
I20260808 02:37:35.842839 12847 ts_tablet_manager.cc:1397] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260808 02:37:35.844128 12847 raft_consensus.cc:348] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:35.844435 12847 raft_consensus.cc:374] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:35.844540 12847 raft_consensus.cc:729] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Initialized, Role: FOLLOWER
I20260808 02:37:35.844961 12847 consensus_queue.cc:260] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:35.846236 12847 ts_tablet_manager.cc:1428] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:37:36.152070 12807 raft_consensus.cc:482] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:36.152402 12807 raft_consensus.cc:504] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.153286 12807 leader_election.cc:288] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863), 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765)
I20260808 02:37:36.154392 12375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4413db80a342b199ff0f1f8bb3b337" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" is_pre_election: true
I20260808 02:37:36.154439 12527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4413db80a342b199ff0f1f8bb3b337" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57814e95a3cd4c2ab63cd56f92928485" is_pre_election: true
I20260808 02:37:36.154759 12527 raft_consensus.cc:2454] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 0.
I20260808 02:37:36.154778 12375 raft_consensus.cc:2454] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 0.
I20260808 02:37:36.155452 12598 leader_election.cc:302] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 2115219dfbc44859a39c084aad4ad1bb, 57814e95a3cd4c2ab63cd56f92928485; no voters:
I20260808 02:37:36.155889 12807 raft_consensus.cc:2781] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:36.156037 12807 raft_consensus.cc:482] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:36.156167 12807 raft_consensus.cc:3037] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:36.158437 12807 raft_consensus.cc:504] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.159236 12807 leader_election.cc:288] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 election: Requested vote from peers 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863), 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765)
I20260808 02:37:36.159981 12375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4413db80a342b199ff0f1f8bb3b337" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a131fb9c0849378e83b4b3dcd5f7af"
I20260808 02:37:36.159945 12527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4413db80a342b199ff0f1f8bb3b337" candidate_uuid: "2115219dfbc44859a39c084aad4ad1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57814e95a3cd4c2ab63cd56f92928485"
I20260808 02:37:36.160250 12375 raft_consensus.cc:3037] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:36.160351 12527 raft_consensus.cc:3037] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:36.162716 12375 raft_consensus.cc:2454] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 1.
I20260808 02:37:36.163012 12527 raft_consensus.cc:2454] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2115219dfbc44859a39c084aad4ad1bb in term 1.
I20260808 02:37:36.163409 12600 leader_election.cc:302] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 2115219dfbc44859a39c084aad4ad1bb; no voters:
I20260808 02:37:36.163930 12807 raft_consensus.cc:2781] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:36.164175 12807 raft_consensus.cc:686] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 1 LEADER]: Becoming Leader. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Running, Role: LEADER
I20260808 02:37:36.164541 12807 consensus_queue.cc:237] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.168025 12203 catalog_manager.cc:5495] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67). New cstate: current_term: 1 leader_uuid: "2115219dfbc44859a39c084aad4ad1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } health_report { overall_health: HEALTHY } } }
I20260808 02:37:36.226919 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.221396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56994 (local address 127.10.20.67:41863)
0808 02:37:36.221984 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:36.221990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:36.222012 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:37:36.222075 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:36.222078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:36.222144 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:36.222256 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:36.222704 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.223532 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.224958 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.225403 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.225553 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.226051 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:36.226173 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:36.226277 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:36.226449 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 02:37:36.226539 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":311,"threads_started":1}
I20260808 02:37:36.238667 12375 raft_consensus.cc:1261] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Refusing update from remote peer 2115219dfbc44859a39c084aad4ad1bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:36.238695 12527 raft_consensus.cc:1261] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Refusing update from remote peer 2115219dfbc44859a39c084aad4ad1bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:36.239398 12807 consensus_queue.cc:1035] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:36.239759 12828 consensus_queue.cc:1035] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:36.302711 12205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:36.302997 12205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:36.306478 12205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Sending DeleteTablet for 3 replicas of tablet 2b4413db80a342b199ff0f1f8bb3b337
I20260808 02:37:36.307682 12355 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4413db80a342b199ff0f1f8bb3b337 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:36 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:55992
I20260808 02:37:36.307852 12651 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4413db80a342b199ff0f1f8bb3b337 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:36 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:51408
I20260808 02:37:36.307775 12501 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4413db80a342b199ff0f1f8bb3b337 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:36 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:42252
I20260808 02:37:36.310359 12205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:36.311501 12205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:36.317301 12869 tablet_replica.cc:330] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: stopping tablet replica
I20260808 02:37:36.317553 12869 raft_consensus.cc:2229] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:36.317787 12871 tablet_replica.cc:330] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: stopping tablet replica
I20260808 02:37:36.317891 12869 raft_consensus.cc:2258] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:36.318490 12871 raft_consensus.cc:2229] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:36.319130 12871 raft_consensus.cc:2258] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:36.319501 12869 ts_tablet_manager.cc:1905] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:36.319973 12870 tablet_replica.cc:330] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: stopping tablet replica
I20260808 02:37:36.320245 12870 raft_consensus.cc:2229] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:36.320549 12871 ts_tablet_manager.cc:1905] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:36.320587 12870 raft_consensus.cc:2258] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:36.322649 12870 ts_tablet_manager.cc:1905] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:36.322997 12355 tablet_service.cc:1467] Processing CreateTablet for tablet 422073a21b29402788fa1015ae7399fc (DEFAULT_TABLE table=test-table [id=25b6216599e248719c1087c09ce7eadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:36.323539 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 422073a21b29402788fa1015ae7399fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:36.324479 12651 tablet_service.cc:1467] Processing CreateTablet for tablet 422073a21b29402788fa1015ae7399fc (DEFAULT_TABLE table=test-table [id=25b6216599e248719c1087c09ce7eadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:36.325023 12651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 422073a21b29402788fa1015ae7399fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:36.328827 12871 ts_tablet_manager.cc:1918] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:36.329026 12871 log.cc:1196] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/2b4413db80a342b199ff0f1f8bb3b337
I20260808 02:37:36.329556 12871 ts_tablet_manager.cc:1939] T 2b4413db80a342b199ff0f1f8bb3b337 P 2115219dfbc44859a39c084aad4ad1bb: Deleting consensus metadata
I20260808 02:37:36.330793 12870 ts_tablet_manager.cc:1918] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:36.330930 12191 catalog_manager.cc:4841] TS 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863): tablet 2b4413db80a342b199ff0f1f8bb3b337 (table test-table [id=5e1722ac49b1448aa7025c58f07ac78b]) successfully deleted
I20260808 02:37:36.331163 12870 log.cc:1196] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/2b4413db80a342b199ff0f1f8bb3b337
I20260808 02:37:36.331570 12501 tablet_service.cc:1467] Processing CreateTablet for tablet 422073a21b29402788fa1015ae7399fc (DEFAULT_TABLE table=test-table [id=25b6216599e248719c1087c09ce7eadf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:36.331861 12870 ts_tablet_manager.cc:1939] T 2b4413db80a342b199ff0f1f8bb3b337 P 57814e95a3cd4c2ab63cd56f92928485: Deleting consensus metadata
I20260808 02:37:36.332093 12501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 422073a21b29402788fa1015ae7399fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:36.332756 12845 tablet_bootstrap.cc:492] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Bootstrap starting.
I20260808 02:37:36.333374 12188 catalog_manager.cc:4841] TS 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765): tablet 2b4413db80a342b199ff0f1f8bb3b337 (table test-table [id=5e1722ac49b1448aa7025c58f07ac78b]) successfully deleted
I20260808 02:37:36.334865 12845 tablet_bootstrap.cc:654] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:36.337822 12847 tablet_bootstrap.cc:492] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Bootstrap starting.
I20260808 02:37:36.336737 12869 ts_tablet_manager.cc:1918] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:37:36.338151 12869 log.cc:1196] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/2b4413db80a342b199ff0f1f8bb3b337
I20260808 02:37:36.338716 12869 ts_tablet_manager.cc:1939] T 2b4413db80a342b199ff0f1f8bb3b337 P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting consensus metadata
I20260808 02:37:36.339766 12845 tablet_bootstrap.cc:492] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: No bootstrap required, opened a new log
I20260808 02:37:36.339955 12845 ts_tablet_manager.cc:1397] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260808 02:37:36.340183 12847 tablet_bootstrap.cc:654] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:36.340802 12845 raft_consensus.cc:348] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.341035 12189 catalog_manager.cc:4841] TS 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863): tablet 2b4413db80a342b199ff0f1f8bb3b337 (table test-table [id=5e1722ac49b1448aa7025c58f07ac78b]) successfully deleted
I20260808 02:37:36.341102 12845 raft_consensus.cc:374] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:36.341195 12845 raft_consensus.cc:729] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a131fb9c0849378e83b4b3dcd5f7af, State: Initialized, Role: FOLLOWER
I20260808 02:37:36.341356 12873 tablet_bootstrap.cc:492] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Bootstrap starting.
I20260808 02:37:36.341476 12845 consensus_queue.cc:260] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.342408 12845 ts_tablet_manager.cc:1428] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 02:37:36.344616 12873 tablet_bootstrap.cc:654] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:36.345227 12847 tablet_bootstrap.cc:492] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: No bootstrap required, opened a new log
I20260808 02:37:36.345450 12847 ts_tablet_manager.cc:1397] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260808 02:37:36.347184 12847 raft_consensus.cc:348] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.347518 12847 raft_consensus.cc:374] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:36.347585 12873 tablet_bootstrap.cc:492] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: No bootstrap required, opened a new log
I20260808 02:37:36.347623 12847 raft_consensus.cc:729] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2115219dfbc44859a39c084aad4ad1bb, State: Initialized, Role: FOLLOWER
I20260808 02:37:36.347748 12873 ts_tablet_manager.cc:1397] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 02:37:36.347885 12847 consensus_queue.cc:260] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.348580 12847 ts_tablet_manager.cc:1428] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 02:37:36.348753 12873 raft_consensus.cc:348] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.349058 12873 raft_consensus.cc:374] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:36.349169 12873 raft_consensus.cc:729] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57814e95a3cd4c2ab63cd56f92928485, State: Initialized, Role: FOLLOWER
I20260808 02:37:36.349447 12873 consensus_queue.cc:260] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.350178 12873 ts_tablet_manager.cc:1428] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 02:37:36.437685 12850 raft_consensus.cc:482] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:36.438099 12850 raft_consensus.cc:504] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.440508 12850 leader_election.cc:288] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765), 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863)
I20260808 02:37:36.449178 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.441401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:54565 (local address 127.10.20.67:41863)
0808 02:37:36.441606 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:36.441612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:36.441735 (+ 123us) server_negotiation.cc:407] Connection header received
0808 02:37:36.442188 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:36.442195 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:36.442295 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:36.442396 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:36.443390 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.444352 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.446644 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.447839 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.447996 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.448134 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:36.448545 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 02:37:36.448693 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:37:36.449455 12876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.440865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:41863 (local address 127.10.20.65:54565)
0808 02:37:36.441619 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:36.441643 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:36.441876 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:36.442653 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:36.442660 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:36.442743 (+ 83us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:36.443178 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.443192 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.444522 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.444529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.446434 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.446450 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.448081 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.448088 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.448291 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.448338 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 02:37:36.448461 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 02:37:36.448637 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":741,"threads_started":1}
I20260808 02:37:36.450448 12877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.440923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.10.20.65:47441)
0808 02:37:36.442455 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:36.442476 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:36.442602 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:36.443201 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:36.443206 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:36.443238 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:36.443637 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.443648 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.445451 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.445457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.447201 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.447219 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.449481 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.449491 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.449775 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.449815 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:37:36.449907 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 02:37:36.450094 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1383,"thread_start_us":1036,"threads_started":1}
I20260808 02:37:36.450404 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "422073a21b29402788fa1015ae7399fc" candidate_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2115219dfbc44859a39c084aad4ad1bb" is_pre_election: true
I20260808 02:37:36.450623 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.441344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:47441 (local address 127.10.20.66:33765)
0808 02:37:36.442820 (+ 1476us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:36.442826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:36.442855 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:37:36.442955 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:36.442960 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:36.443042 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:36.443154 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:36.444079 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.445262 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.447508 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.448703 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.448911 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.448985 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:36.449974 (+ 989us) server_negotiation.cc:299] Negotiation successful
0808 02:37:36.450242 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1281,"thread_start_us":1135,"threads_started":1}
I20260808 02:37:36.451232 12673 raft_consensus.cc:2454] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a131fb9c0849378e83b4b3dcd5f7af in term 0.
I20260808 02:37:36.451565 12527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "422073a21b29402788fa1015ae7399fc" candidate_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57814e95a3cd4c2ab63cd56f92928485" is_pre_election: true
I20260808 02:37:36.451886 12527 raft_consensus.cc:2454] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08a131fb9c0849378e83b4b3dcd5f7af in term 0.
I20260808 02:37:36.452075 12304 leader_election.cc:302] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 2115219dfbc44859a39c084aad4ad1bb; no voters:
I20260808 02:37:36.452905 12850 raft_consensus.cc:2781] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:36.453099 12850 raft_consensus.cc:482] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:36.453212 12850 raft_consensus.cc:3037] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:36.455955 12850 raft_consensus.cc:504] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.456660 12850 leader_election.cc:288] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [CANDIDATE]: Term 1 election: Requested vote from peers 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765), 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863)
I20260808 02:37:36.457383 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "422073a21b29402788fa1015ae7399fc" candidate_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2115219dfbc44859a39c084aad4ad1bb"
I20260808 02:37:36.457684 12673 raft_consensus.cc:3037] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:36.457752 12527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "422073a21b29402788fa1015ae7399fc" candidate_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57814e95a3cd4c2ab63cd56f92928485"
I20260808 02:37:36.458020 12527 raft_consensus.cc:3037] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:36.461166 12673 raft_consensus.cc:2454] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a131fb9c0849378e83b4b3dcd5f7af in term 1.
I20260808 02:37:36.461216 12527 raft_consensus.cc:2454] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08a131fb9c0849378e83b4b3dcd5f7af in term 1.
I20260808 02:37:36.461836 12304 leader_election.cc:302] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a131fb9c0849378e83b4b3dcd5f7af, 2115219dfbc44859a39c084aad4ad1bb; no voters:
I20260808 02:37:36.462253 12850 raft_consensus.cc:2781] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:36.462837 12850 raft_consensus.cc:686] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 LEADER]: Becoming Leader. State: Replica: 08a131fb9c0849378e83b4b3dcd5f7af, State: Running, Role: LEADER
I20260808 02:37:36.463744 12850 consensus_queue.cc:237] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } }
I20260808 02:37:36.468254 12205 catalog_manager.cc:5495] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af reported cstate change: term changed from 0 to 1, leader changed from <none> to 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65). New cstate: current_term: 1 leader_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08a131fb9c0849378e83b4b3dcd5f7af" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 } health_report { overall_health: UNKNOWN } } }
I20260808 02:37:36.518204 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.511122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40994 (local address 127.10.20.65:39863)
0808 02:37:36.512000 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:36.512004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:36.512024 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:37:36.512121 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:36.512124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:36.512202 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:36.512350 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:36.512894 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.513853 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.515461 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.515940 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.516067 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.516609 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:36.517271 (+ 662us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:36.517387 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:36.517665 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 02:37:36.517790 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":580,"threads_started":1}
I20260808 02:37:36.536877 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.530527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:42323 (local address 127.10.20.66:33765)
0808 02:37:36.530918 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:36.530923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:36.531378 (+ 455us) server_negotiation.cc:407] Connection header received
0808 02:37:36.531551 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:36.531555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:36.531627 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:36.531717 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:36.532300 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.533293 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.534929 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.535392 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.535512 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.536138 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:36.536258 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:36.536343 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:36.536555 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 02:37:36.536656 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 02:37:36.537130 12884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.530302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:33765 (local address 127.10.20.65:42323)
0808 02:37:36.531266 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:36.531283 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:36.531421 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:36.531749 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:36.531753 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:36.531762 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:36.532136 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.532146 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.533474 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.533479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.534667 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.534756 (+ 89us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.535618 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.535623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.535768 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.535851 (+ 83us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:36.536401 (+ 550us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:36.536420 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 02:37:36.536504 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 02:37:36.536630 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":593,"threads_started":1}
I20260808 02:37:36.547022 12527 raft_consensus.cc:1261] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Refusing update from remote peer 08a131fb9c0849378e83b4b3dcd5f7af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:36.547264 12673 raft_consensus.cc:1261] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Refusing update from remote peer 08a131fb9c0849378e83b4b3dcd5f7af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:36.547933 12879 consensus_queue.cc:1035] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "57814e95a3cd4c2ab63cd56f92928485" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:36.548357 12850 consensus_queue.cc:1035] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "2115219dfbc44859a39c084aad4ad1bb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:36.591600 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.572456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:47315 (local address 127.10.20.65:39863)
0808 02:37:36.572979 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:36.572986 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:36.584721 (+ 11735us) server_negotiation.cc:407] Connection header received
0808 02:37:36.584922 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:36.584929 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:36.585017 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:36.585080 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:36.585962 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.586835 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.589198 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.589792 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.589978 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.590555 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:36.590751 (+ 196us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:36.590867 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:36.591123 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 02:37:36.591225 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382}
I20260808 02:37:36.591683 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:36.572554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:39863 (local address 127.10.20.66:47315)
0808 02:37:36.584568 (+ 12014us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:36.584592 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:36.584745 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:36.585298 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:36.585303 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:36.585316 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:37:36.585751 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.585768 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.586987 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.586994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.588903 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:36.588927 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:36.590054 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:36.590062 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:36.590287 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:36.590342 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:37:36.590887 (+ 545us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:37:36.590907 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 02:37:36.591081 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 02:37:36.591268 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11825,"thread_start_us":11669,"threads_started":1}
W20260808 02:37:36.593099 12856 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 02:37:38.209314 12204 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:38.209558 12204 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:38.214924 12204 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7042224a7834cc48f4b4c382492ae34: Sending DeleteTablet for 3 replicas of tablet 422073a21b29402788fa1015ae7399fc
I20260808 02:37:38.215972 12355 tablet_service.cc:1514] Processing DeleteTablet for tablet 422073a21b29402788fa1015ae7399fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:38 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:55992
I20260808 02:37:38.215991 12503 tablet_service.cc:1514] Processing DeleteTablet for tablet 422073a21b29402788fa1015ae7399fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:38 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:42252
I20260808 02:37:38.216784 12651 tablet_service.cc:1514] Processing DeleteTablet for tablet 422073a21b29402788fa1015ae7399fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:38 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:51408
I20260808 02:37:38.216972 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12282
I20260808 02:37:38.220670 12921 tablet_replica.cc:330] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: stopping tablet replica
I20260808 02:37:38.220963 12921 raft_consensus.cc:2229] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:38.221294 12921 raft_consensus.cc:2258] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:38.221935 12920 tablet_replica.cc:330] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: stopping tablet replica
I20260808 02:37:38.222172 12920 raft_consensus.cc:2229] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:38.222784 12920 raft_consensus.cc:2258] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:38.223235 12919 tablet_replica.cc:330] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: stopping tablet replica
I20260808 02:37:38.223518 12919 raft_consensus.cc:2229] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:38.223835 12919 raft_consensus.cc:2258] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:38.224052 12920 ts_tablet_manager.cc:1905] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:38.225126 12919 ts_tablet_manager.cc:1905] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:38.233932 12920 ts_tablet_manager.cc:1918] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:37:38.234143 12920 log.cc:1196] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/422073a21b29402788fa1015ae7399fc
I20260808 02:37:38.234760 12920 ts_tablet_manager.cc:1939] T 422073a21b29402788fa1015ae7399fc P 08a131fb9c0849378e83b4b3dcd5f7af: Deleting consensus metadata
I20260808 02:37:38.228134 12921 ts_tablet_manager.cc:1905] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:38.236182 12189 catalog_manager.cc:4841] TS 08a131fb9c0849378e83b4b3dcd5f7af (127.10.20.65:39863): tablet 422073a21b29402788fa1015ae7399fc (table test-table [id=25b6216599e248719c1087c09ce7eadf]) successfully deleted
I20260808 02:37:38.238286 12919 ts_tablet_manager.cc:1918] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:37:38.238580 12919 log.cc:1196] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/422073a21b29402788fa1015ae7399fc
I20260808 02:37:38.239286 12919 ts_tablet_manager.cc:1939] T 422073a21b29402788fa1015ae7399fc P 57814e95a3cd4c2ab63cd56f92928485: Deleting consensus metadata
I20260808 02:37:38.240846 12188 catalog_manager.cc:4841] TS 57814e95a3cd4c2ab63cd56f92928485 (127.10.20.66:33765): tablet 422073a21b29402788fa1015ae7399fc (table test-table [id=25b6216599e248719c1087c09ce7eadf]) successfully deleted
I20260808 02:37:38.243789 12921 ts_tablet_manager.cc:1918] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 02:37:38.243993 12921 log.cc:1196] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/422073a21b29402788fa1015ae7399fc
I20260808 02:37:38.244522 12921 ts_tablet_manager.cc:1939] T 422073a21b29402788fa1015ae7399fc P 2115219dfbc44859a39c084aad4ad1bb: Deleting consensus metadata
I20260808 02:37:38.246325 12191 catalog_manager.cc:4841] TS 2115219dfbc44859a39c084aad4ad1bb (127.10.20.67:41863): tablet 422073a21b29402788fa1015ae7399fc (table test-table [id=25b6216599e248719c1087c09ce7eadf]) successfully deleted
Aug 08 02:37:38 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156655, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:38.266309 12923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:38.218739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40998 (local address 127.10.20.65:39863)
0808 02:37:38.244628 (+ 25889us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:38.244636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:38.244666 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:37:38.244741 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:38.244744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:38.244818 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:38.244943 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:38.247819 (+ 2876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:38.249690 (+ 1871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:38.251689 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:38.252494 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:38.252667 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:38.257964 (+ 5297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:38.257985 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:38.258038 (+ 53us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:38.258103 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:38.262182 (+ 4079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:38.263242 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:38.263253 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:38.263258 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:38.263455 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:38.264003 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:38.264008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:38.264012 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:38.264575 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:38.264957 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:38.265508 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 02:37:38.265858 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25061,"thread_start_us":27396,"threads_started":1}
W20260808 02:37:38.267400 12424 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40998
W20260808 02:37:38.268368 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12282: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:38.268707 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 12282
I20260808 02:37:38.305773 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12433
Aug 08 02:37:38 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156655, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:37:38.325575 12924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:38.306665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41194 (local address 127.10.20.66:33765)
0808 02:37:38.307298 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:38.307302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:38.307319 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:37:38.307375 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:38.307379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:38.307448 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:38.307546 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:38.309024 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:38.309928 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:38.311659 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:38.312131 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:38.312246 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:38.317926 (+ 5680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:38.317947 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:38.317971 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:38.318029 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:38.321834 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:38.323029 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:38.323039 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:38.323042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:38.323217 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:38.323696 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:38.323701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:38.323703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:38.324164 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:38.324447 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:38.324836 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 02:37:38.325209 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":362,"threads_started":1}
W20260808 02:37:38.326503 12572 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41194
W20260808 02:37:38.327474 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12433: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:38.327812 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 12433
I20260808 02:37:38.360802 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12581
Aug 08 02:37:38 dist-test-slave-8tdl krb5kdc[12155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156655, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:37:38.380822 12925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:38.361607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56998 (local address 127.10.20.67:41863)
0808 02:37:38.362285 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:38.362290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:38.362307 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:37:38.362365 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:38.362369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:38.362429 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:38.362532 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:38.364376 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:38.365432 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:38.367115 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:38.367607 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:38.367728 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:38.373565 (+ 5837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:38.373583 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:38.373601 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:38.373648 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:38.377296 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:38.378376 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:38.378385 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:38.378388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:38.378573 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:38.379073 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:38.379077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:38.379079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:38.379476 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:38.379825 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:38.380157 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 02:37:38.380431 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":410,"threads_started":1}
W20260808 02:37:38.381681 12720 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56998
W20260808 02:37:38.382617 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12581: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:38.382892 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 12581
I20260808 02:37:38.411016 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12169
I20260808 02:37:38.412696 12248 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:38.539037 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 12169
2026-08-08T02:37:38Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9308 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:38 dist-test-slave-8tdl krb5kdc[12929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:38 dist-test-slave-8tdl krb5kdc[12929](info): set up 2 sockets
Aug 08 02:37:38 dist-test-slave-8tdl krb5kdc[12929](info): commencing operation
krb5kdc: starting...
W20260808 02:37:39.739951 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 02:37:39.982911 10321 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.243s user 0.002s sys 0.009s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 02:37:40.196527 10321 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.213s user 0.001s sys 0.010s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 02:37:40.347481 10321 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.151s user 0.001s sys 0.009s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/test-user.keytab.
W20260808 02:37:40.844568 10321 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.497s user 0.000s sys 0.009s
Aug 08 02:37:40 dist-test-slave-8tdl krb5kdc[12929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:40.992213 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:40417
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:40417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:41.377895 12942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:41.378379 12942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:41.378547 12942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:41.386320 12942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:41.386466 12942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:41.386516 12942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:41.386613 12942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:41.386713 12942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:41.397879 12942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:40417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:40417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:41.399443 12942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:41.400902 12942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:41.415391 12950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:41.415520 12948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:41.415422 12947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:41.416266 12942 server_base.cc:1034] running on GCE node
I20260808 02:37:41.417205 12942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:41.418992 12942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:41.420292 12942 hybrid_clock.cc:648] HybridClock initialized: now 1786156661420211 us; error 74 us; skew 500 ppm
I20260808 02:37:41.420807 12942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:41 dist-test-slave-8tdl krb5kdc[12929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156661, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:41.424716 12942 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:41.426786 12942 webserver.cc:460] Webserver started at http://127.10.20.126:43711/ using document root <none> and password file <none>
I20260808 02:37:41.427666 12942 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:41.427845 12942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:41.428224 12942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:41.432011 12942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "93617b473629455fac6e218d06c28253"
format_stamp: "Formatted at 2026-08-08 02:37:41 on dist-test-slave-8tdl"
server_key: "49b54908876af4d4007485a09db9c542"
server_key_iv: "d2105d7d0ef35e12d55ba1394fedde9a"
server_key_version: "encryptionkey@0"
I20260808 02:37:41.432981 12942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "93617b473629455fac6e218d06c28253"
format_stamp: "Formatted at 2026-08-08 02:37:41 on dist-test-slave-8tdl"
server_key: "49b54908876af4d4007485a09db9c542"
server_key_iv: "d2105d7d0ef35e12d55ba1394fedde9a"
server_key_version: "encryptionkey@0"
I20260808 02:37:41.439291 12942 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:37:41.443761 12957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:41.445629 12942 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:37:41.445983 12942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "93617b473629455fac6e218d06c28253"
format_stamp: "Formatted at 2026-08-08 02:37:41 on dist-test-slave-8tdl"
server_key: "49b54908876af4d4007485a09db9c542"
server_key_iv: "d2105d7d0ef35e12d55ba1394fedde9a"
server_key_version: "encryptionkey@0"
I20260808 02:37:41.446265 12942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:41.467651 12942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:41.472795 12942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:41.473155 12942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:41.494776 12942 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:40417
I20260808 02:37:41.494895 13012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:40417 every 8 connection(s)
I20260808 02:37:41.496364 12942 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:41.501034 13013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:41.503027 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 12942
I20260808 02:37:41.503327 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:41.504279 10321 external_mini_cluster.cc:1428] Setting key 639f6322ad40defe2a5eaf8ab793ef68
I20260808 02:37:41.518900 13013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253: Bootstrap starting.
Aug 08 02:37:41 dist-test-slave-8tdl krb5kdc[12929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:41.523568 13013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:41.524839 13013 log.cc:824] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:41.528718 13013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253: No bootstrap required, opened a new log
I20260808 02:37:41.532873 13016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:41.507085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49328 (local address 127.10.20.126:40417)
0808 02:37:41.508048 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:41.508062 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:41.508115 (+ 53us) server_negotiation.cc:407] Connection header received
0808 02:37:41.509908 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:41.509938 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:41.510455 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:41.510934 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:41.513051 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:41.514954 (+ 1903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:41.517310 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:41.518188 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:41.518368 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:41.524023 (+ 5655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:41.524037 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:41.524069 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:41.524128 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:41.527903 (+ 3775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:41.528889 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:41.528902 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:41.528912 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:41.529138 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:41.529635 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:41.529640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:41.529650 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:41.530270 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:41.530650 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:41.531208 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 02:37:41.531708 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":442,"threads_started":1}
I20260808 02:37:41.538209 13013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93617b473629455fac6e218d06c28253" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40417 } }
I20260808 02:37:41.538754 13013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:41.538890 13013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93617b473629455fac6e218d06c28253, State: Initialized, Role: FOLLOWER
I20260808 02:37:41.539585 13013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93617b473629455fac6e218d06c28253" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40417 } }
I20260808 02:37:41.539865 13013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:41.540046 13013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:41.540228 13013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:41.543442 13013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93617b473629455fac6e218d06c28253" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40417 } }
I20260808 02:37:41.544096 13013 leader_election.cc:302] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93617b473629455fac6e218d06c28253; no voters:
I20260808 02:37:41.544783 13013 leader_election.cc:288] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:41.544962 13019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:41.545830 13019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [term 1 LEADER]: Becoming Leader. State: Replica: 93617b473629455fac6e218d06c28253, State: Running, Role: LEADER
I20260808 02:37:41.546528 13019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93617b473629455fac6e218d06c28253" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40417 } }
I20260808 02:37:41.547263 13013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:41.550011 13020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93617b473629455fac6e218d06c28253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93617b473629455fac6e218d06c28253" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40417 } } }
I20260808 02:37:41.550935 13020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:41.550133 13021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93617b473629455fac6e218d06c28253. Latest consensus state: current_term: 1 leader_uuid: "93617b473629455fac6e218d06c28253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93617b473629455fac6e218d06c28253" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40417 } } }
I20260808 02:37:41.553122 13021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:41.553350 13028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:41.559026 13028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:41.570147 13028 catalog_manager.cc:1347] Generated new cluster ID: 1efea0dfddcb411689a9188506662bc5
I20260808 02:37:41.570298 13028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:41.589905 13028 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:41.591768 13028 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:41.609964 13028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93617b473629455fac6e218d06c28253: Generated new TSK 0
I20260808 02:37:41.611011 13028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:41.696767 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:40417
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:42.078833 13041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:42.079177 13041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:42.079281 13041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:42.087071 13041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:42.087211 13041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:42.087337 13041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:42.098271 13041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:40417
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:42.099850 13041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:42.101377 13041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:42.116760 13047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:42.116729 13050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:42.116855 13048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:42.117950 13041 server_base.cc:1034] running on GCE node
I20260808 02:37:42.118849 13041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:42.120054 13041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:42.121366 13041 hybrid_clock.cc:648] HybridClock initialized: now 1786156662121297 us; error 57 us; skew 500 ppm
I20260808 02:37:42.121765 13041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:42 dist-test-slave-8tdl krb5kdc[12929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156662, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:42.125682 13041 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:42.127697 13041 webserver.cc:460] Webserver started at http://127.10.20.65:40887/ using document root <none> and password file <none>
I20260808 02:37:42.128556 13041 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:42.128720 13041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:42.129128 13041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:42.132786 13041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "7a91e07ded374bd8874118f11a56f288"
format_stamp: "Formatted at 2026-08-08 02:37:42 on dist-test-slave-8tdl"
server_key: "51f17875430cdc732289cfd2ab45a269"
server_key_iv: "aee26c4af3bfbe6b7e94f9833761c5a6"
server_key_version: "encryptionkey@0"
I20260808 02:37:42.133797 13041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "7a91e07ded374bd8874118f11a56f288"
format_stamp: "Formatted at 2026-08-08 02:37:42 on dist-test-slave-8tdl"
server_key: "51f17875430cdc732289cfd2ab45a269"
server_key_iv: "aee26c4af3bfbe6b7e94f9833761c5a6"
server_key_version: "encryptionkey@0"
I20260808 02:37:42.140677 13041 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 02:37:42.145308 13057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:42.147176 13041 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:42.147416 13041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "7a91e07ded374bd8874118f11a56f288"
format_stamp: "Formatted at 2026-08-08 02:37:42 on dist-test-slave-8tdl"
server_key: "51f17875430cdc732289cfd2ab45a269"
server_key_iv: "aee26c4af3bfbe6b7e94f9833761c5a6"
server_key_version: "encryptionkey@0"
I20260808 02:37:42.147696 13041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:42.183216 13041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:42.188681 13041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:42.189066 13041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:42.190308 13041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:42.191900 13041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:42.192023 13041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:42.192194 13041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:42.192272 13041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:42.230777 13041 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:34693
I20260808 02:37:42.230876 13176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:34693 every 8 connection(s)
I20260808 02:37:42.232251 13041 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:42.237071 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13041
I20260808 02:37:42.237346 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:42.238047 10321 external_mini_cluster.cc:1428] Setting key 7bdb525f6926f65908a3e5f8816f8843
Aug 08 02:37:42 dist-test-slave-8tdl krb5kdc[12929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156662, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:42.257026 13179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:42.235497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:56531 (local address 127.10.20.126:40417)
0808 02:37:42.236000 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:42.236004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:42.237162 (+ 1158us) server_negotiation.cc:407] Connection header received
0808 02:37:42.239832 (+ 2670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:42.239838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:42.239919 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:42.240028 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:42.241916 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.242756 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.244484 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.244917 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.245083 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:42.249413 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:42.249419 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:42.249423 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:42.249467 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:42.253332 (+ 3865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:42.254257 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:42.254264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:42.254268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:42.254424 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:42.255015 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:42.255022 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:42.255026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:42.255343 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:42.255556 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:42.256366 (+ 810us) server_negotiation.cc:299] Negotiation successful
0808 02:37:42.256648 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":248,"threads_started":1}
I20260808 02:37:42.258101 13180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:42.236119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:40417 (local address 127.10.20.65:56531)
0808 02:37:42.236943 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:42.237008 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:42.239471 (+ 2463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:42.240390 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:42.240405 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:42.241066 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:42.241706 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:42.241726 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.242942 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.242946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:42.244291 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:42.244305 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.245212 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.245219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:42.245491 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:42.246270 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:42.246300 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:42.249120 (+ 2820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:42.253525 (+ 4405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:42.253535 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:42.253554 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:42.254097 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:42.254561 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:42.254566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:42.254570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:42.254882 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:42.255490 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:42.255500 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:42.255930 (+ 430us) client_negotiation.cc:769] Sending connection context
0808 02:37:42.256233 (+ 303us) client_negotiation.cc:240] Negotiation successful
0808 02:37:42.256828 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":368,"threads_started":1}
I20260808 02:37:42.260180 13177 heartbeater.cc:347] Connected to a master server at 127.10.20.126:40417
I20260808 02:37:42.260598 13177 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:42.261550 13177 heartbeater.cc:511] Master 127.10.20.126:40417 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:37:42.264735 12976 ts_manager.cc:194] Registered new tserver with Master: 7a91e07ded374bd8874118f11a56f288 (127.10.20.65:34693)
I20260808 02:37:42.266440 12976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:56531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:42.303205 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:40417
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:42.680023 13183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:42.680428 13183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:42.680612 13183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:42.688429 13183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:42.688640 13183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:42.688851 13183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:42.699668 13183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:40417
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:42.701236 13183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:42.702785 13183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:42.718451 13189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:42.718394 13192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:42.718369 13190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:42.719722 13183 server_base.cc:1034] running on GCE node
I20260808 02:37:42.720598 13183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:42.721910 13183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:42.723207 13183 hybrid_clock.cc:648] HybridClock initialized: now 1786156662723152 us; error 53 us; skew 500 ppm
I20260808 02:37:42.723654 13183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:42 dist-test-slave-8tdl krb5kdc[12929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156662, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:42.727785 13183 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:42.729774 13183 webserver.cc:460] Webserver started at http://127.10.20.66:42095/ using document root <none> and password file <none>
I20260808 02:37:42.730628 13183 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:42.730854 13183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:42.731299 13183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:42.734903 13183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "506dcde9a16b4924bb5e30a74a8d4584"
format_stamp: "Formatted at 2026-08-08 02:37:42 on dist-test-slave-8tdl"
server_key: "4bc8dc8636bc8dbc5a0c7b020b59d8ec"
server_key_iv: "a51c5ca6bbf89a957ec8d71abe49ef96"
server_key_version: "encryptionkey@0"
I20260808 02:37:42.735918 13183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "506dcde9a16b4924bb5e30a74a8d4584"
format_stamp: "Formatted at 2026-08-08 02:37:42 on dist-test-slave-8tdl"
server_key: "4bc8dc8636bc8dbc5a0c7b020b59d8ec"
server_key_iv: "a51c5ca6bbf89a957ec8d71abe49ef96"
server_key_version: "encryptionkey@0"
I20260808 02:37:42.742519 13183 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:37:42.747205 13199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:42.749228 13183 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:37:42.749585 13183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "506dcde9a16b4924bb5e30a74a8d4584"
format_stamp: "Formatted at 2026-08-08 02:37:42 on dist-test-slave-8tdl"
server_key: "4bc8dc8636bc8dbc5a0c7b020b59d8ec"
server_key_iv: "a51c5ca6bbf89a957ec8d71abe49ef96"
server_key_version: "encryptionkey@0"
I20260808 02:37:42.749956 13183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:42.779765 13183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:42.786178 13183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:42.787191 13183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:42.788702 13183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:42.792294 13183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:42.792456 13183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:42.792654 13183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:42.792742 13183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:42.836849 13183 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:39421
I20260808 02:37:42.836870 13315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:39421 every 8 connection(s)
I20260808 02:37:42.838445 13183 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:42.844462 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13183
I20260808 02:37:42.844692 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:42.845252 10321 external_mini_cluster.cc:1428] Setting key 61e2f6ac1c96a796702651282173f2c6
Aug 08 02:37:42 dist-test-slave-8tdl krb5kdc[12929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156662, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:42.867106 13318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:42.841882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:50499 (local address 127.10.20.126:40417)
0808 02:37:42.842460 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:42.842465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:42.843571 (+ 1106us) server_negotiation.cc:407] Connection header received
0808 02:37:42.845928 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:42.845935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:42.846046 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:42.846187 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:42.848689 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.849661 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.852181 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.852868 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.853042 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:42.857837 (+ 4795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:42.857845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:42.857848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:42.857894 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:42.862638 (+ 4744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:42.863854 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:42.863860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:42.863862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:42.864045 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:42.864819 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:42.864824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:42.864827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:42.865193 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:42.865403 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:42.866315 (+ 912us) server_negotiation.cc:299] Negotiation successful
0808 02:37:42.866624 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":333,"threads_started":1}
I20260808 02:37:42.868595 13319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:42.842407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:40417 (local address 127.10.20.66:50499)
0808 02:37:42.843339 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:42.843390 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:42.845526 (+ 2136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:42.846499 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:42.846510 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:42.847315 (+ 805us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:42.848406 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:42.848437 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.849904 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.849909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:42.851938 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:42.851961 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:42.853190 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:42.853199 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:42.853513 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:42.854441 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:42.854478 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:42.857474 (+ 2996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:42.863056 (+ 5582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:42.863066 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:42.863085 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:42.863653 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:42.864187 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:42.864197 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:42.864199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:42.864431 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:42.865370 (+ 939us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:42.865381 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:42.865827 (+ 446us) client_negotiation.cc:769] Sending connection context
0808 02:37:42.866181 (+ 354us) client_negotiation.cc:240] Negotiation successful
0808 02:37:42.866947 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":431,"threads_started":1}
I20260808 02:37:42.870702 13316 heartbeater.cc:347] Connected to a master server at 127.10.20.126:40417
I20260808 02:37:42.871173 13316 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:42.872344 13316 heartbeater.cc:511] Master 127.10.20.126:40417 requested a full tablet report, sending...
I20260808 02:37:42.874442 12976 ts_manager.cc:194] Registered new tserver with Master: 506dcde9a16b4924bb5e30a74a8d4584 (127.10.20.66:39421)
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
I20260808 02:37:42.875557 12976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:50499
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:42.916869 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:40417
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:43.271073 13177 heartbeater.cc:503] Master 127.10.20.126:40417 was elected leader, sending a full tablet report...
W20260808 02:37:43.304652 13322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:43.304986 13322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:43.305087 13322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:43.313174 13322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:43.313304 13322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:43.313433 13322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:43.324209 13322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:40417
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:43.325644 13322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:43.327137 13322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:43.343173 13327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:43.343379 13328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:43.343238 13331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:43.344082 13322 server_base.cc:1034] running on GCE node
I20260808 02:37:43.344858 13322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:43.346036 13322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:43.347314 13322 hybrid_clock.cc:648] HybridClock initialized: now 1786156663347234 us; error 79 us; skew 500 ppm
I20260808 02:37:43.347851 13322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:43 dist-test-slave-8tdl krb5kdc[12929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156663, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:43.352118 13322 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:43.354209 13322 webserver.cc:460] Webserver started at http://127.10.20.67:46011/ using document root <none> and password file <none>
I20260808 02:37:43.355300 13322 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:43.355443 13322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:43.355791 13322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:43.359514 13322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "a323588d8b6d4241a1e79ea6c5910ae5"
format_stamp: "Formatted at 2026-08-08 02:37:43 on dist-test-slave-8tdl"
server_key: "55351c9cb2e67546cc8043bbb32cd530"
server_key_iv: "49584a395deb42b396dd4741dfe19d81"
server_key_version: "encryptionkey@0"
I20260808 02:37:43.360553 13322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "a323588d8b6d4241a1e79ea6c5910ae5"
format_stamp: "Formatted at 2026-08-08 02:37:43 on dist-test-slave-8tdl"
server_key: "55351c9cb2e67546cc8043bbb32cd530"
server_key_iv: "49584a395deb42b396dd4741dfe19d81"
server_key_version: "encryptionkey@0"
I20260808 02:37:43.367342 13322 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:37:43.372073 13338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:43.374089 13322 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:43.374343 13322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "a323588d8b6d4241a1e79ea6c5910ae5"
format_stamp: "Formatted at 2026-08-08 02:37:43 on dist-test-slave-8tdl"
server_key: "55351c9cb2e67546cc8043bbb32cd530"
server_key_iv: "49584a395deb42b396dd4741dfe19d81"
server_key_version: "encryptionkey@0"
I20260808 02:37:43.374600 13322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:43.411748 13322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:43.417092 13322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:43.417452 13322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:43.418632 13322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:43.420375 13322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:43.420465 13322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:43.420629 13322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:43.420686 13322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:43.465880 13322 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:41811
I20260808 02:37:43.466013 13459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:41811 every 8 connection(s)
I20260808 02:37:43.467607 13322 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:43.468092 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13322
I20260808 02:37:43.468320 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:43.468993 10321 external_mini_cluster.cc:1428] Setting key 7f1f36b698cc5f6ce6aa69919906ff1a
Aug 08 02:37:43 dist-test-slave-8tdl krb5kdc[12929](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156663, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:43.493848 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:43.470924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:60485 (local address 127.10.20.126:40417)
0808 02:37:43.471524 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:43.471531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:43.472908 (+ 1377us) server_negotiation.cc:407] Connection header received
0808 02:37:43.475232 (+ 2324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:43.475239 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:43.475370 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:43.475496 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:43.477365 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:43.478335 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:43.480736 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:43.481256 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:43.481386 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:43.486611 (+ 5225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:43.486617 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:43.486621 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:43.486664 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:43.489899 (+ 3235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:43.491040 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:43.491045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:43.491048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:43.491206 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:43.491798 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:43.491814 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:43.491816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:43.492142 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:43.492285 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:43.493289 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0808 02:37:43.493539 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":291,"threads_started":1}
I20260808 02:37:43.495142 13463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:43.471707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:40417 (local address 127.10.20.67:60485)
0808 02:37:43.472700 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:43.472770 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:43.474862 (+ 2092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:43.475801 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:43.475811 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:43.476433 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:43.477139 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:43.477160 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:43.478613 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:43.478620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:43.480530 (+ 1910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:43.480549 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:43.481553 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:43.481560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:43.481807 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:43.482808 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:43.482872 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:43.486326 (+ 3454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:43.490188 (+ 3862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:43.490202 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:43.490219 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:43.490860 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:43.491376 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:43.491380 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:43.491383 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:43.491644 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:43.492320 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:43.492328 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:43.492782 (+ 454us) client_negotiation.cc:769] Sending connection context
0808 02:37:43.493134 (+ 352us) client_negotiation.cc:240] Negotiation successful
0808 02:37:43.493640 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":385,"threads_started":1}
I20260808 02:37:43.497264 13460 heartbeater.cc:347] Connected to a master server at 127.10.20.126:40417
I20260808 02:37:43.497692 13460 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:43.498765 13460 heartbeater.cc:511] Master 127.10.20.126:40417 requested a full tablet report, sending...
I20260808 02:37:43.500530 12976 ts_manager.cc:194] Registered new tserver with Master: a323588d8b6d4241a1e79ea6c5910ae5 (127.10.20.67:41811)
I20260808 02:37:43.501467 12976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:60485
I20260808 02:37:43.512372 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 02:37:43.561905 13462 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:43.558919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49336 (local address 127.10.20.126:40417)
0808 02:37:43.559256 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:43.559264 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:43.559628 (+ 364us) server_negotiation.cc:407] Connection header received
0808 02:37:43.559868 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:43.559872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:43.559964 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:43.560087 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:43.561595 (+ 1508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49336: BlockingRecv error: recv got EOF from 127.0.0.1:49336 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
I20260808 02:37:43.565568 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13041
W20260808 02:37:43.569357 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13041: Not authorized: Client connection negotiation failed: client connection to 127.10.20.65:34693: server requires authentication, but client does not have Kerberos credentials available
I20260808 02:37:43.569689 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13041
I20260808 02:37:43.588588 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13183
W20260808 02:37:43.592995 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13183: Not authorized: Client connection negotiation failed: client connection to 127.10.20.66:39421: server requires authentication, but client does not have Kerberos credentials available
I20260808 02:37:43.593209 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13183
W20260808 02:37:43.593276 13474 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:37:43.590085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.10.20.66:39421)
0808 02:37:43.590843 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:43.590851 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:43.590883 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:37:43.591350 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:43.591363 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:43.591649 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:43.591826 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:43.592804 (+ 978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59706: BlockingRecv error: recv got EOF from 127.0.0.1:59706 (error 108)
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":390,"threads_started":1}
I20260808 02:37:43.612742 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13322
W20260808 02:37:43.616526 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13322: Not authorized: Client connection negotiation failed: client connection to 127.10.20.67:41811: server requires authentication, but client does not have Kerberos credentials available
I20260808 02:37:43.616696 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13322
I20260808 02:37:43.636490 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 12942
I20260808 02:37:43.637948 13007 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:43.761562 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 12942
2026-08-08T02:37:43Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (5221 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:43 dist-test-slave-8tdl krb5kdc[13479](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:43 dist-test-slave-8tdl krb5kdc[13479](info): set up 2 sockets
Aug 08 02:37:43 dist-test-slave-8tdl krb5kdc[13479](info): commencing operation
krb5kdc: starting...
W20260808 02:37:45.010841 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:45 dist-test-slave-8tdl krb5kdc[13479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:45.308998 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44335
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:44335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:45.691778 13493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:45.692137 13493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:45.692231 13493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:45.700212 13493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:45.700362 13493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:45.700412 13493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:45.700469 13493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:45.700520 13493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:45.712250 13493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:44335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:45.713718 13493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:45.715739 13493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:45.736014 13499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:45.736374 13502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:45.736580 13500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:45.738988 13493 server_base.cc:1034] running on GCE node
I20260808 02:37:45.740810 13493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:45.743006 13493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:45.744350 13493 hybrid_clock.cc:648] HybridClock initialized: now 1786156665744301 us; error 66 us; skew 500 ppm
I20260808 02:37:45.744841 13493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:45 dist-test-slave-8tdl krb5kdc[13479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156665, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:45.748880 13493 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:45.751399 13493 webserver.cc:460] Webserver started at http://127.10.20.126:33065/ using document root <none> and password file <none>
I20260808 02:37:45.752411 13493 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:45.752555 13493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:45.752928 13493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:45.757009 13493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec"
format_stamp: "Formatted at 2026-08-08 02:37:45 on dist-test-slave-8tdl"
server_key: "12657c5fb20409a9c98a04f62d3eea28"
server_key_iv: "819c55d7a0f9a7cbcfe46f4c1c1c2314"
server_key_version: "encryptionkey@0"
I20260808 02:37:45.758241 13493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec"
format_stamp: "Formatted at 2026-08-08 02:37:45 on dist-test-slave-8tdl"
server_key: "12657c5fb20409a9c98a04f62d3eea28"
server_key_iv: "819c55d7a0f9a7cbcfe46f4c1c1c2314"
server_key_version: "encryptionkey@0"
I20260808 02:37:45.765750 13493 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 02:37:45.771016 13509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:45.772748 13493 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:45.773008 13493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec"
format_stamp: "Formatted at 2026-08-08 02:37:45 on dist-test-slave-8tdl"
server_key: "12657c5fb20409a9c98a04f62d3eea28"
server_key_iv: "819c55d7a0f9a7cbcfe46f4c1c1c2314"
server_key_version: "encryptionkey@0"
I20260808 02:37:45.773260 13493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:45.797049 13493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:45.802419 13493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:45.802793 13493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:45.824712 13493 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:44335
I20260808 02:37:45.824766 13560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:44335 every 8 connection(s)
I20260808 02:37:45.826354 13493 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:45.830498 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13493
I20260808 02:37:45.830821 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:45.831583 13562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:45.831732 10321 external_mini_cluster.cc:1428] Setting key 384f5675982e2383e3a02edc0714c002
I20260808 02:37:45.848829 13562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec: Bootstrap starting.
Aug 08 02:37:45 dist-test-slave-8tdl krb5kdc[13479](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:45.852974 13562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:45.854282 13562 log.cc:824] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:45.857808 13562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec: No bootstrap required, opened a new log
I20260808 02:37:45.859563 13566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:45.833968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55712 (local address 127.10.20.126:44335)
0808 02:37:45.834971 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:45.834983 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:45.835030 (+ 47us) server_negotiation.cc:407] Connection header received
0808 02:37:45.837299 (+ 2269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:45.837329 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:45.837851 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:45.838291 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:45.840571 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:45.842023 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:45.844084 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:45.844989 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:45.845174 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:45.850570 (+ 5396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:45.850580 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:45.850601 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:45.850658 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:45.854575 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:45.855652 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:45.855660 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:45.855668 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:45.855873 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:45.856350 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:45.856354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:45.856356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:45.856962 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:45.857314 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:45.857805 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 02:37:45.858387 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":447,"threads_started":1}
I20260808 02:37:45.864449 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:37:45.867864 13562 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44335 } }
I20260808 02:37:45.868494 13562 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:45.868676 13562 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2dae2e180cb4b6d9f58fdebfe3106ec, State: Initialized, Role: FOLLOWER
I20260808 02:37:45.869508 13562 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44335 } }
I20260808 02:37:45.869848 13562 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:45.870011 13562 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:45.870211 13562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:45.874169 13562 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44335 } }
I20260808 02:37:45.874993 13562 leader_election.cc:302] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2dae2e180cb4b6d9f58fdebfe3106ec; no voters:
I20260808 02:37:45.875801 13562 leader_election.cc:288] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:45.876077 13568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:45.877789 13568 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [term 1 LEADER]: Becoming Leader. State: Replica: d2dae2e180cb4b6d9f58fdebfe3106ec, State: Running, Role: LEADER
I20260808 02:37:45.878737 13562 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:45.878732 13568 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44335 } }
I20260808 02:37:45.885358 13569 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44335 } } }
I20260808 02:37:45.886169 13569 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:45.885358 13570 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2dae2e180cb4b6d9f58fdebfe3106ec. Latest consensus state: current_term: 1 leader_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2dae2e180cb4b6d9f58fdebfe3106ec" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44335 } } }
I20260808 02:37:45.887024 13570 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:45.889302 13576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:45.895676 13576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:45.910640 13576 catalog_manager.cc:1347] Generated new cluster ID: 165021e84cee42a2a205ea11beb12b79
I20260808 02:37:45.910849 13576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:45.917716 13588 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:37:45.941252 13576 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:45.942344 13566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:45.931362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55722 (local address 127.10.20.126:44335)
0808 02:37:45.931640 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:45.931651 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:45.932340 (+ 689us) server_negotiation.cc:407] Connection header received
0808 02:37:45.932582 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:45.932592 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:45.932668 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:45.932810 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:45.933988 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:45.934908 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:45.936359 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:45.936832 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:45.936992 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:45.938492 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:45.938500 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:45.938504 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:37:45.941202 (+ 2698us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:45.941267 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:37:45.941306 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:45.941499 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:45.941787 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 02:37:45.941919 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:37:45.944037 13576 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:45.961450 13576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2dae2e180cb4b6d9f58fdebfe3106ec: Generated new TSK 0
I20260808 02:37:45.962471 13576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:37:45.977589 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13493
I20260808 02:37:45.980229 13556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:46.084859 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13493
2026-08-08T02:37:46Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2313 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:46 dist-test-slave-8tdl krb5kdc[13597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:46 dist-test-slave-8tdl krb5kdc[13597](info): set up 2 sockets
Aug 08 02:37:46 dist-test-slave-8tdl krb5kdc[13597](info): commencing operation
krb5kdc: starting...
W20260808 02:37:47.283201 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.002s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:47 dist-test-slave-8tdl krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:47.584512 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37257
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:47.980151 13610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:47.980499 13610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:47.980602 13610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:47.988382 13610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:47.988528 13610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:47.988579 13610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:47.988631 13610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:47.988673 13610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:47.999859 13610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:48.001379 13610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:48.002913 13610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:48.017112 13617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:48.017159 13616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:48.017208 13619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:48.018090 13610 server_base.cc:1034] running on GCE node
I20260808 02:37:48.019143 13610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:48.020954 13610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:48.022210 13610 hybrid_clock.cc:648] HybridClock initialized: now 1786156668022161 us; error 45 us; skew 500 ppm
I20260808 02:37:48.022729 13610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:48 dist-test-slave-8tdl krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156668, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:48.031493 13610 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:48.033595 13610 webserver.cc:460] Webserver started at http://127.10.20.126:46503/ using document root <none> and password file <none>
I20260808 02:37:48.034475 13610 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:48.034752 13610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:48.035171 13610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:48.038748 13610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "9d4928887fcc444e976a6021345f53d5"
format_stamp: "Formatted at 2026-08-08 02:37:48 on dist-test-slave-8tdl"
server_key: "68575d5932f72fb141a3f4a0bebf8580"
server_key_iv: "372090f125a6a9b7fc03d793b8e4587c"
server_key_version: "encryptionkey@0"
I20260808 02:37:48.039738 13610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "9d4928887fcc444e976a6021345f53d5"
format_stamp: "Formatted at 2026-08-08 02:37:48 on dist-test-slave-8tdl"
server_key: "68575d5932f72fb141a3f4a0bebf8580"
server_key_iv: "372090f125a6a9b7fc03d793b8e4587c"
server_key_version: "encryptionkey@0"
I20260808 02:37:48.046191 13610 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.006s
I20260808 02:37:48.051132 13626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:48.052776 13610 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:48.053005 13610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "9d4928887fcc444e976a6021345f53d5"
format_stamp: "Formatted at 2026-08-08 02:37:48 on dist-test-slave-8tdl"
server_key: "68575d5932f72fb141a3f4a0bebf8580"
server_key_iv: "372090f125a6a9b7fc03d793b8e4587c"
server_key_version: "encryptionkey@0"
I20260808 02:37:48.053242 13610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:48.076254 13610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:48.081431 13610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:48.081801 13610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:48.102826 13610 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:37257
I20260808 02:37:48.103055 13679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:37257 every 8 connection(s)
I20260808 02:37:48.104437 13610 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:48.105214 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13610
I20260808 02:37:48.105531 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:48.106383 10321 external_mini_cluster.cc:1428] Setting key 427d777318dd059b6b89de8a9495afaa
I20260808 02:37:48.109300 13680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:37:48 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:48.124755 13680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5: Bootstrap starting.
I20260808 02:37:48.129175 13680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:48.130663 13680 log.cc:824] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:48.134557 13680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5: No bootstrap required, opened a new log
I20260808 02:37:48.135083 13683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:48.109046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52678 (local address 127.10.20.126:37257)
0808 02:37:48.109924 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:48.109954 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:48.110011 (+ 57us) server_negotiation.cc:407] Connection header received
0808 02:37:48.112492 (+ 2481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:48.112526 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:48.113142 (+ 616us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:48.113686 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:48.115326 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:48.117482 (+ 2156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:48.119134 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:48.120251 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:48.120498 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:48.125723 (+ 5225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:48.125733 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:48.125751 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:48.125804 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:48.129683 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:48.130983 (+ 1300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:48.130991 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:48.130999 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:48.131229 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:48.131792 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:48.131799 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:48.131804 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:48.132606 (+ 802us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:48.132886 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:48.133404 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 02:37:48.133850 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":393,"threads_started":1}
I20260808 02:37:48.144256 13680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d4928887fcc444e976a6021345f53d5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37257 } }
I20260808 02:37:48.145011 13680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:48.145167 13680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d4928887fcc444e976a6021345f53d5, State: Initialized, Role: FOLLOWER
I20260808 02:37:48.145963 13680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d4928887fcc444e976a6021345f53d5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37257 } }
I20260808 02:37:48.146245 13680 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:48.146360 13680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:48.146505 13680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:48.149084 13680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d4928887fcc444e976a6021345f53d5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37257 } }
I20260808 02:37:48.149680 13680 leader_election.cc:302] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d4928887fcc444e976a6021345f53d5; no voters:
I20260808 02:37:48.150301 13680 leader_election.cc:288] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:48.150511 13685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:48.152230 13685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [term 1 LEADER]: Becoming Leader. State: Replica: 9d4928887fcc444e976a6021345f53d5, State: Running, Role: LEADER
I20260808 02:37:48.152897 13680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:48.152916 13685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d4928887fcc444e976a6021345f53d5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37257 } }
I20260808 02:37:48.156518 13687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d4928887fcc444e976a6021345f53d5. Latest consensus state: current_term: 1 leader_uuid: "9d4928887fcc444e976a6021345f53d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d4928887fcc444e976a6021345f53d5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37257 } } }
I20260808 02:37:48.157060 13687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:48.157073 13686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d4928887fcc444e976a6021345f53d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d4928887fcc444e976a6021345f53d5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37257 } } }
I20260808 02:37:48.159526 13686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:48.160810 13693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:48.167572 13693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:48.178809 13693 catalog_manager.cc:1347] Generated new cluster ID: 3b115a4f25d44a4480a5a5958be1fd55
I20260808 02:37:48.178974 13693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:48.189488 13693 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:48.191905 13693 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:48.206019 13693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d4928887fcc444e976a6021345f53d5: Generated new TSK 0
I20260808 02:37:48.207399 13693 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:48.279318 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37257
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:48.677711 13708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:48.678122 13708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:48.678313 13708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:48.686306 13708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:48.686527 13708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:48.686798 13708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:48.697436 13708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:48.699045 13708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:48.700554 13708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:48.716676 13714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:48.716714 13716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:48.716770 13713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:48.718109 13708 server_base.cc:1034] running on GCE node
I20260808 02:37:48.718988 13708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:48.720196 13708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:48.721544 13708 hybrid_clock.cc:648] HybridClock initialized: now 1786156668721430 us; error 62 us; skew 500 ppm
I20260808 02:37:48.721961 13708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:48 dist-test-slave-8tdl krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156668, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:48.726454 13708 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:48.728628 13708 webserver.cc:460] Webserver started at http://127.10.20.65:35413/ using document root <none> and password file <none>
I20260808 02:37:48.729532 13708 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:48.729712 13708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:48.730132 13708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:48.733916 13708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "a723aea3b3a048d9a26b409945a7a0f1"
format_stamp: "Formatted at 2026-08-08 02:37:48 on dist-test-slave-8tdl"
server_key: "21b8198cb72f6c9243ee04d65ea3bacb"
server_key_iv: "4c6b7b290651a995bbd15b1161126c56"
server_key_version: "encryptionkey@0"
I20260808 02:37:48.735167 13708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "a723aea3b3a048d9a26b409945a7a0f1"
format_stamp: "Formatted at 2026-08-08 02:37:48 on dist-test-slave-8tdl"
server_key: "21b8198cb72f6c9243ee04d65ea3bacb"
server_key_iv: "4c6b7b290651a995bbd15b1161126c56"
server_key_version: "encryptionkey@0"
I20260808 02:37:48.741948 13708 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:37:48.746944 13723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:48.748862 13708 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:48.749154 13708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "a723aea3b3a048d9a26b409945a7a0f1"
format_stamp: "Formatted at 2026-08-08 02:37:48 on dist-test-slave-8tdl"
server_key: "21b8198cb72f6c9243ee04d65ea3bacb"
server_key_iv: "4c6b7b290651a995bbd15b1161126c56"
server_key_version: "encryptionkey@0"
I20260808 02:37:48.749454 13708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:48.771636 13708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:48.777396 13708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:48.777788 13708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:48.779027 13708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:48.780634 13708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:48.780754 13708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:48.780926 13708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:48.781001 13708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:48.823732 13708 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:44635
I20260808 02:37:48.823794 13842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:44635 every 8 connection(s)
I20260808 02:37:48.825240 13708 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:48.827075 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13708
I20260808 02:37:48.827318 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:48.828152 10321 external_mini_cluster.cc:1428] Setting key 0b9233a69d0546b869c42efc748990e1
Aug 08 02:37:48 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156668, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:48.851470 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:48.828810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:54753 (local address 127.10.20.126:37257)
0808 02:37:48.829362 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:48.829369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:48.830714 (+ 1345us) server_negotiation.cc:407] Connection header received
0808 02:37:48.832671 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:48.832677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:48.832778 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:48.832908 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:48.834736 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:48.835526 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:48.837532 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:48.838202 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:48.838423 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:48.843439 (+ 5016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:48.843445 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:48.843448 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:48.843491 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:48.846912 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:48.848407 (+ 1495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:48.848412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:48.848415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:48.848597 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:48.849286 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:48.849292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:48.849295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:48.849641 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:48.849774 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:48.850938 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0808 02:37:48.851160 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":284,"threads_started":1}
I20260808 02:37:48.853406 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:48.829492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37257 (local address 127.10.20.65:54753)
0808 02:37:48.830468 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:48.830526 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:48.832345 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:48.833204 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:48.833213 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:48.833794 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:48.834449 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:48.834468 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:48.835749 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:48.835753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:48.837333 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:48.837350 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:48.838571 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:48.838581 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:48.838934 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:48.839724 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:48.839754 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:48.843066 (+ 3312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:48.847149 (+ 4083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:48.847163 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:48.847189 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:48.848202 (+ 1013us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:48.848749 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:48.848758 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:48.848765 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:48.849105 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:48.849807 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:48.849819 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:48.850411 (+ 592us) client_negotiation.cc:769] Sending connection context
0808 02:37:48.850825 (+ 414us) client_negotiation.cc:240] Negotiation successful
0808 02:37:48.851604 (+ 779us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":358,"threads_started":1}
I20260808 02:37:48.855892 13844 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37257
I20260808 02:37:48.856302 13844 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:48.857388 13844 heartbeater.cc:511] Master 127.10.20.126:37257 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:37:48.860425 13645 ts_manager.cc:194] Registered new tserver with Master: a723aea3b3a048d9a26b409945a7a0f1 (127.10.20.65:44635)
I20260808 02:37:48.862263 13645 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:54753
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:48.901029 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37257
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:49.281695 13850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:49.282030 13850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:49.282204 13850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:49.290028 13850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:49.290326 13850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:49.290736 13850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:49.304870 13850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:49.306439 13850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:49.308076 13850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:49.325299 13855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:49.325338 13859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:49.325263 13856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:49.326550 13850 server_base.cc:1034] running on GCE node
I20260808 02:37:49.327406 13850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:49.328634 13850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:49.329878 13850 hybrid_clock.cc:648] HybridClock initialized: now 1786156669329831 us; error 73 us; skew 500 ppm
I20260808 02:37:49.330305 13850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:49 dist-test-slave-8tdl krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156669, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:49.333983 13850 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:49.335867 13850 webserver.cc:460] Webserver started at http://127.10.20.66:35843/ using document root <none> and password file <none>
I20260808 02:37:49.336639 13850 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:49.336796 13850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:49.337240 13850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:49.340592 13850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "127a4221b1d7494895914a020d654ec8"
format_stamp: "Formatted at 2026-08-08 02:37:49 on dist-test-slave-8tdl"
server_key: "c311820247986c1bc3916d08319f4757"
server_key_iv: "b55173f2e385cfa803aece0b32999746"
server_key_version: "encryptionkey@0"
I20260808 02:37:49.341416 13850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "127a4221b1d7494895914a020d654ec8"
format_stamp: "Formatted at 2026-08-08 02:37:49 on dist-test-slave-8tdl"
server_key: "c311820247986c1bc3916d08319f4757"
server_key_iv: "b55173f2e385cfa803aece0b32999746"
server_key_version: "encryptionkey@0"
I20260808 02:37:49.347738 13850 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:37:49.352321 13867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:49.354420 13850 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:49.354647 13850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "127a4221b1d7494895914a020d654ec8"
format_stamp: "Formatted at 2026-08-08 02:37:49 on dist-test-slave-8tdl"
server_key: "c311820247986c1bc3916d08319f4757"
server_key_iv: "b55173f2e385cfa803aece0b32999746"
server_key_version: "encryptionkey@0"
I20260808 02:37:49.355010 13850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:49.393424 13850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:49.398356 13850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:49.398772 13850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:49.399932 13850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:49.401577 13850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:49.401700 13850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:49.401863 13850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:49.401973 13850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:49.444023 13850 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:35545
I20260808 02:37:49.444304 13985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:35545 every 8 connection(s)
I20260808 02:37:49.445487 13850 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:49.454492 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13850
I20260808 02:37:49.454735 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:49.455327 10321 external_mini_cluster.cc:1428] Setting key e93ba8286db24631e9bb47221bb56d7d
Aug 08 02:37:49 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156669, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:49.476984 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:49.449468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37257 (local address 127.10.20.66:37985)
0808 02:37:49.451006 (+ 1538us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:49.451061 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:49.453289 (+ 2228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:49.455247 (+ 1958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:49.455261 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:49.455992 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:49.456948 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:49.456974 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:49.458273 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:49.458277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:49.459987 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:49.460005 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:49.461009 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:49.461018 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:49.461293 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:49.462062 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:49.462088 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:49.464840 (+ 2752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:49.469382 (+ 4542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:49.469396 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:49.469431 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:49.470310 (+ 879us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:49.470941 (+ 631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:49.470950 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:49.470955 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:49.471258 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:49.472101 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:49.472111 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:49.473675 (+ 1564us) client_negotiation.cc:769] Sending connection context
0808 02:37:49.474102 (+ 427us) client_negotiation.cc:240] Negotiation successful
0808 02:37:49.474867 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"thread_start_us":365,"threads_started":1}
I20260808 02:37:49.481894 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:49.448834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:37985 (local address 127.10.20.126:37257)
0808 02:37:49.449373 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:49.449378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:49.451254 (+ 1876us) server_negotiation.cc:407] Connection header received
0808 02:37:49.454288 (+ 3034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:49.454297 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:49.454455 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:49.454638 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:49.457178 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:49.458073 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:49.460202 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:49.460727 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:49.460871 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:49.465176 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:49.465185 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:49.465192 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:49.465249 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:49.469136 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:49.470553 (+ 1417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:49.470558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:49.470560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:49.470811 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:49.471418 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:49.471426 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:49.471432 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:49.471842 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:49.472120 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:49.480931 (+ 8811us) server_negotiation.cc:299] Negotiation successful
0808 02:37:49.481312 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":277,"threads_started":1}
I20260808 02:37:49.484081 13986 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37257
I20260808 02:37:49.484562 13986 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:49.485719 13986 heartbeater.cc:511] Master 127.10.20.126:37257 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
I20260808 02:37:49.488026 13645 ts_manager.cc:194] Registered new tserver with Master: 127a4221b1d7494895914a020d654ec8 (127.10.20.66:35545)
I20260808 02:37:49.489820 13645 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:37985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:49.534665 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37257
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:49.867161 13844 heartbeater.cc:503] Master 127.10.20.126:37257 was elected leader, sending a full tablet report...
W20260808 02:37:50.024344 13992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:50.025156 13992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:50.025388 13992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:50.035450 13992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:50.035626 13992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:50.035818 13992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:50.046998 13992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:50.048591 13992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:50.050168 13992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:50.068254 13997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:50.068370 13998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:50.068285 14000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:50.068796 13992 server_base.cc:1034] running on GCE node
I20260808 02:37:50.069737 13992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:50.071131 13992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:50.072711 13992 hybrid_clock.cc:648] HybridClock initialized: now 1786156670072603 us; error 96 us; skew 500 ppm
I20260808 02:37:50.073254 13992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:50.077642 13992 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:50.080137 13992 webserver.cc:460] Webserver started at http://127.10.20.67:39641/ using document root <none> and password file <none>
I20260808 02:37:50.081058 13992 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:50.081195 13992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:50.081494 13992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:50.085464 13992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "fd2df17668704d2493fdb85e6ad92029"
format_stamp: "Formatted at 2026-08-08 02:37:50 on dist-test-slave-8tdl"
server_key: "4f8aab0e68cad1f7777dcfa24ade41f4"
server_key_iv: "a41ec4e8168efaad11827dc05ade6e4d"
server_key_version: "encryptionkey@0"
I20260808 02:37:50.086445 13992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "fd2df17668704d2493fdb85e6ad92029"
format_stamp: "Formatted at 2026-08-08 02:37:50 on dist-test-slave-8tdl"
server_key: "4f8aab0e68cad1f7777dcfa24ade41f4"
server_key_iv: "a41ec4e8168efaad11827dc05ade6e4d"
server_key_version: "encryptionkey@0"
I20260808 02:37:50.094434 13992 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 02:37:50.099673 14010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:50.102428 13992 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260808 02:37:50.102895 13992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "fd2df17668704d2493fdb85e6ad92029"
format_stamp: "Formatted at 2026-08-08 02:37:50 on dist-test-slave-8tdl"
server_key: "4f8aab0e68cad1f7777dcfa24ade41f4"
server_key_iv: "a41ec4e8168efaad11827dc05ade6e4d"
server_key_version: "encryptionkey@0"
I20260808 02:37:50.103224 13992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:50.123495 13992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:50.129736 13992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:50.130165 13992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:50.131959 13992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:50.134238 13992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:50.134395 13992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:50.134608 13992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:50.134727 13992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:50.187695 13992 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:43153
I20260808 02:37:50.188292 14125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:43153 every 8 connection(s)
I20260808 02:37:50.189898 13992 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:50.196424 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 13992
I20260808 02:37:50.197006 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:50.197741 10321 external_mini_cluster.cc:1428] Setting key 65a0812442e0fbdd5d57e58860f46bde
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:50.218921 14128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:50.193327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:34697 (local address 127.10.20.126:37257)
0808 02:37:50.194201 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:50.194206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:50.196295 (+ 2089us) server_negotiation.cc:407] Connection header received
0808 02:37:50.199395 (+ 3100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:50.199401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:50.199528 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:50.199682 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:50.202306 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.203174 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.205180 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.205657 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.205781 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:50.210263 (+ 4482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:50.210270 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:50.210274 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:50.210327 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:50.213811 (+ 3484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.215108 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.215115 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.215120 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.215316 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.215865 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.215870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.215872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.216733 (+ 861us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:50.216889 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:50.218145 (+ 1256us) server_negotiation.cc:299] Negotiation successful
0808 02:37:50.218378 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":483,"threads_started":1}
I20260808 02:37:50.220230 14129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:50.194256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37257 (local address 127.10.20.67:34697)
0808 02:37:50.195803 (+ 1547us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:50.196050 (+ 247us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:50.199022 (+ 2972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:50.200193 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:50.200210 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:50.201296 (+ 1086us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:50.202122 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:50.202147 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.203499 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.203504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:50.204975 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:50.204992 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.205929 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.205935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:50.206247 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:50.207050 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:50.207076 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:50.209825 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:50.214017 (+ 4192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:50.214030 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:50.214054 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:50.214890 (+ 836us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:50.215462 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:50.215467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:50.215471 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:50.215708 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:50.216952 (+ 1244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:50.216959 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:50.217513 (+ 554us) client_negotiation.cc:769] Sending connection context
0808 02:37:50.217996 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 02:37:50.218480 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1039,"thread_start_us":716,"threads_started":1}
I20260808 02:37:50.222141 14126 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37257
I20260808 02:37:50.222774 14126 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:50.224558 14126 heartbeater.cc:511] Master 127.10.20.126:37257 requested a full tablet report, sending...
I20260808 02:37:50.227972 13643 ts_manager.cc:194] Registered new tserver with Master: fd2df17668704d2493fdb85e6ad92029 (127.10.20.67:43153)
I20260808 02:37:50.229225 13643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:34697
I20260808 02:37:50.229633 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:50.303650 14128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:50.284940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52684 (local address 127.10.20.126:37257)
0808 02:37:50.285261 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:50.285268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:50.285625 (+ 357us) server_negotiation.cc:407] Connection header received
0808 02:37:50.285831 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:50.285836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:50.286027 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:50.286260 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:50.288240 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.289094 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.290809 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.291322 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.291454 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:50.296480 (+ 5026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:50.296487 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:50.296491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:50.296593 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:50.299728 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.300690 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.300695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.300698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.300950 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.301650 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.301655 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.301657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.302148 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:50.302371 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:50.302934 (+ 563us) server_negotiation.cc:299] Negotiation successful
0808 02:37:50.303180 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
W20260808 02:37:50.304551 13643 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52684
I20260808 02:37:50.306986 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13708
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:50.327867 14138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:50.308971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37006 (local address 127.10.20.65:44635)
0808 02:37:50.309880 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:50.309887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:50.309915 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:37:50.310127 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:50.310144 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:50.310417 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:50.310682 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:50.312249 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.313320 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.314726 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.315374 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.315529 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:50.320752 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:50.320776 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:50.320793 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:50.320843 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:50.324332 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.325389 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.325401 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.325405 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.325574 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.326150 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.326155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.326157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.326565 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:50.326920 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:50.327284 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:37:50.327553 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":395,"threads_started":1}
W20260808 02:37:50.329504 13838 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37006
W20260808 02:37:50.330819 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13708: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:50.331131 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13708
I20260808 02:37:50.351517 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13850
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:37:50.372812 14139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:50.352776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41478 (local address 127.10.20.66:35545)
0808 02:37:50.353460 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:50.353468 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:50.353503 (+ 35us) server_negotiation.cc:407] Connection header received
0808 02:37:50.353568 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:50.353575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:50.353801 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:50.353943 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:50.355699 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.356905 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.358586 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.359455 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.359588 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:50.364681 (+ 5093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:50.364699 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:50.364715 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:50.364779 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:50.368320 (+ 3541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.369333 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.369343 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.369345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.369572 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.370311 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.370316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.370318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.371098 (+ 780us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:50.371383 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:50.371956 (+ 573us) server_negotiation.cc:299] Negotiation successful
0808 02:37:50.372220 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":373,"threads_started":1}
W20260808 02:37:50.374512 13981 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41478
W20260808 02:37:50.376535 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13850: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:50.376741 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13850
I20260808 02:37:50.399768 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13992
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156670, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:37:50.423410 14140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:50.401368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.10.20.67:43153)
0808 02:37:50.402347 (+ 979us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:50.402355 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:50.402395 (+ 40us) server_negotiation.cc:407] Connection header received
0808 02:37:50.402478 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:50.402486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:50.402870 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:50.403142 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:50.404929 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.406423 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.408041 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:50.408692 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:50.408885 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:50.414284 (+ 5399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:50.414304 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:50.414323 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:50.414373 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:50.418442 (+ 4069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.419752 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.419769 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.419771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.420015 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:50.420645 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:50.420653 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:50.420656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:50.421396 (+ 740us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:50.422028 (+ 632us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:50.422652 (+ 624us) server_negotiation.cc:299] Negotiation successful
0808 02:37:50.423060 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":496,"threads_started":1}
W20260808 02:37:50.425731 14121 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46930
W20260808 02:37:50.427414 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13992: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:37:50.427760 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13992
I20260808 02:37:50.449178 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 13610
I20260808 02:37:50.450879 13675 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:50.573885 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 13610
2026-08-08T02:37:50Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4498 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[14145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[14145](info): set up 2 sockets
Aug 08 02:37:50 dist-test-slave-8tdl krb5kdc[14145](info): commencing operation
krb5kdc: starting...
W20260808 02:37:51.850039 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:52 dist-test-slave-8tdl krb5kdc[14145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:52.167971 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:43913
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:44525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:43913
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:52.574607 14158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:52.575129 14158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:52.575296 14158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:52.583783 14158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:52.583998 14158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:52.584131 14158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:52.584234 14158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:52.584329 14158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:52.595398 14158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:44525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:43913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:43913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:52.597311 14158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:52.598984 14158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:52.615206 14163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:52.615262 14166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:52.615175 14164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:52.617512 14158 server_base.cc:1034] running on GCE node
I20260808 02:37:52.619146 14158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:52.621449 14158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:52.622838 14158 hybrid_clock.cc:648] HybridClock initialized: now 1786156672622765 us; error 117 us; skew 500 ppm
I20260808 02:37:52.623376 14158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:52 dist-test-slave-8tdl krb5kdc[14145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156672, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:52.627700 14158 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:52.629890 14158 webserver.cc:460] Webserver started at http://127.10.20.126:34535/ using document root <none> and password file <none>
I20260808 02:37:52.631150 14158 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:52.631352 14158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:52.631763 14158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:52.635605 14158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "37b8e9f45da942cebcb1a6bb9cceb612"
format_stamp: "Formatted at 2026-08-08 02:37:52 on dist-test-slave-8tdl"
server_key: "077b611c8962e317a54d36882dacbb7e"
server_key_iv: "66b081d69d06e28b4ff5fc3feee3ac5b"
server_key_version: "encryptionkey@0"
I20260808 02:37:52.636674 14158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "37b8e9f45da942cebcb1a6bb9cceb612"
format_stamp: "Formatted at 2026-08-08 02:37:52 on dist-test-slave-8tdl"
server_key: "077b611c8962e317a54d36882dacbb7e"
server_key_iv: "66b081d69d06e28b4ff5fc3feee3ac5b"
server_key_version: "encryptionkey@0"
I20260808 02:37:52.643445 14158 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 02:37:52.648279 14175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:52.650516 14158 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260808 02:37:52.650828 14158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "37b8e9f45da942cebcb1a6bb9cceb612"
format_stamp: "Formatted at 2026-08-08 02:37:52 on dist-test-slave-8tdl"
server_key: "077b611c8962e317a54d36882dacbb7e"
server_key_iv: "66b081d69d06e28b4ff5fc3feee3ac5b"
server_key_version: "encryptionkey@0"
I20260808 02:37:52.651113 14158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:52.676064 14158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:52.681334 14158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:52.681728 14158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:52.703541 14158 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:43913
I20260808 02:37:52.703588 14228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:43913 every 8 connection(s)
I20260808 02:37:52.705174 14158 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:52.709754 14229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:52.710484 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14158
I20260808 02:37:52.710753 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:52.711508 10321 external_mini_cluster.cc:1428] Setting key 2d514b36a348c93d8f671ca207869154
I20260808 02:37:52.726511 14229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612: Bootstrap starting.
Aug 08 02:37:52 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:52.730619 14229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:52.732363 14229 log.cc:824] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:52.736857 14229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612: No bootstrap required, opened a new log
I20260808 02:37:52.741921 14232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:52.714160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50084 (local address 127.10.20.126:43913)
0808 02:37:52.715257 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:52.715276 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:52.715341 (+ 65us) server_negotiation.cc:407] Connection header received
0808 02:37:52.717454 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:52.717490 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:52.718168 (+ 678us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:52.718747 (+ 579us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:52.720694 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:52.722935 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:52.724711 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:52.725893 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:52.726142 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:52.730644 (+ 4502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:52.730659 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:52.730717 (+ 58us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:52.730784 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:52.735398 (+ 4614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:52.736642 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:52.736654 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:52.736664 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:52.736966 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:52.737547 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:52.737554 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:52.737558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:52.738400 (+ 842us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:52.738814 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:52.739488 (+ 674us) server_negotiation.cc:299] Negotiation successful
0808 02:37:52.740171 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":457,"threads_started":1}
I20260808 02:37:52.748550 14229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43913 } }
I20260808 02:37:52.749233 14229 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:52.749389 14229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b8e9f45da942cebcb1a6bb9cceb612, State: Initialized, Role: FOLLOWER
I20260808 02:37:52.750236 14229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43913 } }
I20260808 02:37:52.750562 14229 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:52.750744 14229 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:52.750978 14229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:52.753423 14229 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43913 } }
I20260808 02:37:52.754063 14229 leader_election.cc:302] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37b8e9f45da942cebcb1a6bb9cceb612; no voters:
I20260808 02:37:52.755262 14229 leader_election.cc:288] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:52.755539 14234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:52.757195 14234 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [term 1 LEADER]: Becoming Leader. State: Replica: 37b8e9f45da942cebcb1a6bb9cceb612, State: Running, Role: LEADER
I20260808 02:37:52.758230 14234 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43913 } }
I20260808 02:37:52.759132 14229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:52.762274 14236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37b8e9f45da942cebcb1a6bb9cceb612. Latest consensus state: current_term: 1 leader_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43913 } } }
I20260808 02:37:52.762856 14236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:52.762599 14235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37b8e9f45da942cebcb1a6bb9cceb612" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43913 } } }
I20260808 02:37:52.763088 14235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:52.765228 14242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:52.771792 14242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:52.785542 14242 catalog_manager.cc:1347] Generated new cluster ID: 382598a52c584cb0b9e471189f51bf79
I20260808 02:37:52.785753 14242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:52.816572 14242 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:52.818909 14242 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:52.836365 14242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37b8e9f45da942cebcb1a6bb9cceb612: Generated new TSK 0
I20260808 02:37:52.837443 14242 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:52.917649 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43913
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:44525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:53.360766 14255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:53.361186 14255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:53.361367 14255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:53.370409 14255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:53.370609 14255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:53.370859 14255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:53.382349 14255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:44525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43913
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:53.384490 14255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:53.386034 14255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:53.402100 14260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:53.402148 14261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:53.402173 14263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:53.403077 14255 server_base.cc:1034] running on GCE node
I20260808 02:37:53.403980 14255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:53.405227 14255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:53.406531 14255 hybrid_clock.cc:648] HybridClock initialized: now 1786156673406472 us; error 57 us; skew 500 ppm
I20260808 02:37:53.407007 14255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:53 dist-test-slave-8tdl krb5kdc[14145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156673, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:53.417429 14255 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:53.419960 14255 webserver.cc:460] Webserver started at http://127.10.20.65:41903/ using document root <none> and password file <none>
I20260808 02:37:53.421000 14255 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:53.421203 14255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:53.422005 14255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:53.425976 14255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "23c8e76aeb3c4f4a94c7bec886f67d83"
format_stamp: "Formatted at 2026-08-08 02:37:53 on dist-test-slave-8tdl"
server_key: "75bee44c754b33ebd7b9e4921773d051"
server_key_iv: "e640163ba36da3929d31020668e773ad"
server_key_version: "encryptionkey@0"
I20260808 02:37:53.427163 14255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "23c8e76aeb3c4f4a94c7bec886f67d83"
format_stamp: "Formatted at 2026-08-08 02:37:53 on dist-test-slave-8tdl"
server_key: "75bee44c754b33ebd7b9e4921773d051"
server_key_iv: "e640163ba36da3929d31020668e773ad"
server_key_version: "encryptionkey@0"
I20260808 02:37:53.434219 14255 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260808 02:37:53.439033 14270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:53.441058 14255 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:53.441318 14255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "23c8e76aeb3c4f4a94c7bec886f67d83"
format_stamp: "Formatted at 2026-08-08 02:37:53 on dist-test-slave-8tdl"
server_key: "75bee44c754b33ebd7b9e4921773d051"
server_key_iv: "e640163ba36da3929d31020668e773ad"
server_key_version: "encryptionkey@0"
I20260808 02:37:53.441583 14255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:53.462311 14255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:53.470130 14255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:53.470520 14255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:53.471918 14255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:53.473619 14255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:53.473740 14255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:53.473917 14255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:53.473999 14255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:53.514581 14255 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:42699
I20260808 02:37:53.514592 14386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:42699 every 8 connection(s)
I20260808 02:37:53.516193 14255 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:53.523216 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14255
I20260808 02:37:53.523525 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:53.524236 10321 external_mini_cluster.cc:1428] Setting key 5f94ce665f6119c1fd93ceb83d59fa7b
Aug 08 02:37:53 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156673, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:53.549757 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:53.520209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:59817 (local address 127.10.20.126:43913)
0808 02:37:53.520780 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:53.520785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:53.521748 (+ 963us) server_negotiation.cc:407] Connection header received
0808 02:37:53.525259 (+ 3511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:53.525265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:53.525367 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:53.525527 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:53.528302 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:53.529600 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:53.531671 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:53.532429 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:53.532598 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:53.537572 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:53.537581 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:53.537586 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:53.537653 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:53.543537 (+ 5884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:53.544816 (+ 1279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:53.544826 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:53.544832 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:53.545083 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:53.545701 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:53.545710 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:53.545716 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:53.546630 (+ 914us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:53.546907 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:53.548865 (+ 1958us) server_negotiation.cc:299] Negotiation successful
0808 02:37:53.549213 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":323,"threads_started":1}
I20260808 02:37:53.550637 14390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:53.520676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:43913 (local address 127.10.20.65:59817)
0808 02:37:53.521562 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:53.521604 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:53.524435 (+ 2831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:53.526254 (+ 1819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:53.526269 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:53.527291 (+ 1022us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:53.528035 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:53.528060 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:53.529886 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:53.529891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:53.531460 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:53.531482 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:53.532738 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:53.532744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:53.532998 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:53.533847 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:53.533875 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:53.536979 (+ 3104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:53.543855 (+ 6876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:53.543865 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:53.543883 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:53.544555 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:53.545283 (+ 728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:53.545287 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:53.545290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:53.545554 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:53.546975 (+ 1421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:53.546982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:53.547839 (+ 857us) client_negotiation.cc:769] Sending connection context
0808 02:37:53.548615 (+ 776us) client_negotiation.cc:240] Negotiation successful
0808 02:37:53.549186 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":381,"threads_started":1}
I20260808 02:37:53.553618 14387 heartbeater.cc:347] Connected to a master server at 127.10.20.126:43913
I20260808 02:37:53.554064 14387 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:53.555626 14387 heartbeater.cc:511] Master 127.10.20.126:43913 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:37:53.559317 14194 ts_manager.cc:194] Registered new tserver with Master: 23c8e76aeb3c4f4a94c7bec886f67d83 (127.10.20.65:42699)
I20260808 02:37:53.561246 14194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:59817
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:53.600111 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43913
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:44525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:53.989926 14394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:53.990326 14394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:53.990504 14394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:53.998724 14394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:53.998919 14394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:53.999094 14394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:54.012655 14394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:44525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43913
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:54.014248 14394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:54.015940 14394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:54.032459 14400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:54.032591 14399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:54.032572 14402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:54.034070 14394 server_base.cc:1034] running on GCE node
I20260808 02:37:54.034929 14394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:54.036098 14394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:54.037341 14394 hybrid_clock.cc:648] HybridClock initialized: now 1786156674037286 us; error 41 us; skew 500 ppm
I20260808 02:37:54.037752 14394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:54.041465 14394 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:54.043433 14394 webserver.cc:460] Webserver started at http://127.10.20.66:33771/ using document root <none> and password file <none>
I20260808 02:37:54.044298 14394 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:54.044418 14394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:54.044781 14394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:54.048269 14394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "515d77a7f78643689a90ef79f0132886"
format_stamp: "Formatted at 2026-08-08 02:37:54 on dist-test-slave-8tdl"
server_key: "1d964302f94acbfbbb90b10faea1a69c"
server_key_iv: "60d2154889f3864ecebe8fc382dd3ad0"
server_key_version: "encryptionkey@0"
I20260808 02:37:54.049563 14394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "515d77a7f78643689a90ef79f0132886"
format_stamp: "Formatted at 2026-08-08 02:37:54 on dist-test-slave-8tdl"
server_key: "1d964302f94acbfbbb90b10faea1a69c"
server_key_iv: "60d2154889f3864ecebe8fc382dd3ad0"
server_key_version: "encryptionkey@0"
I20260808 02:37:54.056505 14394 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 02:37:54.061348 14409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:54.063344 14394 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:37:54.063637 14394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "515d77a7f78643689a90ef79f0132886"
format_stamp: "Formatted at 2026-08-08 02:37:54 on dist-test-slave-8tdl"
server_key: "1d964302f94acbfbbb90b10faea1a69c"
server_key_iv: "60d2154889f3864ecebe8fc382dd3ad0"
server_key_version: "encryptionkey@0"
I20260808 02:37:54.063913 14394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:54.084486 14394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:54.089586 14394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:54.090008 14394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:54.091221 14394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:54.092866 14394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:54.092989 14394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:54.093154 14394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:54.093230 14394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:54.131682 14394 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:37127
I20260808 02:37:54.131744 14526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:37127 every 8 connection(s)
I20260808 02:37:54.133155 14394 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:54.141356 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14394
I20260808 02:37:54.141611 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:54.142179 10321 external_mini_cluster.cc:1428] Setting key 37bc6928d360e1d191ba9b25848b8cb6
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:54.158284 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.136367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:47783 (local address 127.10.20.126:43913)
0808 02:37:54.136877 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:54.136881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:54.138398 (+ 1517us) server_negotiation.cc:407] Connection header received
0808 02:37:54.140652 (+ 2254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:54.140658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:54.140768 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:54.140897 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:54.143054 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.143912 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.145965 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.146570 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.146757 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.151266 (+ 4509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:54.151273 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:54.151276 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:54.151318 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:54.154202 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.155261 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.155266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.155268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.155453 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.156037 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.156042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.156045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.156385 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:54.156578 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:54.157694 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0808 02:37:54.157993 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":262,"threads_started":1}
I20260808 02:37:54.160018 14530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.137002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:43913 (local address 127.10.20.66:47783)
0808 02:37:54.138096 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:54.138152 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:54.140273 (+ 2121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:54.141206 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:54.141216 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:54.141956 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:54.142778 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:54.142812 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.144214 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.144220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:54.145743 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:54.145759 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.146887 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.146894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:54.147279 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.148059 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:54.148091 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:54.150942 (+ 2851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:54.154409 (+ 3467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:54.154420 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:54.154442 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:54.155089 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:54.155593 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:54.155598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:54.155602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:54.155901 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:54.156586 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:54.156599 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:54.157194 (+ 595us) client_negotiation.cc:769] Sending connection context
0808 02:37:54.157553 (+ 359us) client_negotiation.cc:240] Negotiation successful
0808 02:37:54.158226 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":338,"threads_started":1}
I20260808 02:37:54.161988 14527 heartbeater.cc:347] Connected to a master server at 127.10.20.126:43913
I20260808 02:37:54.162374 14527 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:54.163522 14527 heartbeater.cc:511] Master 127.10.20.126:43913 requested a full tablet report, sending...
I20260808 02:37:54.165728 14194 ts_manager.cc:194] Registered new tserver with Master: 515d77a7f78643689a90ef79f0132886 (127.10.20.66:37127)
I20260808 02:37:54.166790 14194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:47783
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:54.210902 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43913
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:44525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:54.566198 14387 heartbeater.cc:503] Master 127.10.20.126:43913 was elected leader, sending a full tablet report...
W20260808 02:37:54.590651 14533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:54.591101 14533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:54.591266 14533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:54.600046 14533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:54.600205 14533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:54.600414 14533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:54.612998 14533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:44525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43913
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:54.614581 14533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:54.616146 14533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:54.632778 14538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:54.632795 14539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:54.633406 14541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:54.635155 14533 server_base.cc:1034] running on GCE node
I20260808 02:37:54.635968 14533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:54.637178 14533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:54.638492 14533 hybrid_clock.cc:648] HybridClock initialized: now 1786156674638413 us; error 53 us; skew 500 ppm
I20260808 02:37:54.638972 14533 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:54.643165 14533 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:54.645177 14533 webserver.cc:460] Webserver started at http://127.10.20.67:44475/ using document root <none> and password file <none>
I20260808 02:37:54.646204 14533 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:54.646384 14533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:54.646948 14533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:54.650804 14533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "8b22e18987fa4c8ca3d61a76db5eadc2"
format_stamp: "Formatted at 2026-08-08 02:37:54 on dist-test-slave-8tdl"
server_key: "063f4d969eac645453f36ccfbe15fbb8"
server_key_iv: "d4d4632c8daddc62c8e9b00953e503a0"
server_key_version: "encryptionkey@0"
I20260808 02:37:54.651921 14533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "8b22e18987fa4c8ca3d61a76db5eadc2"
format_stamp: "Formatted at 2026-08-08 02:37:54 on dist-test-slave-8tdl"
server_key: "063f4d969eac645453f36ccfbe15fbb8"
server_key_iv: "d4d4632c8daddc62c8e9b00953e503a0"
server_key_version: "encryptionkey@0"
I20260808 02:37:54.659089 14533 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260808 02:37:54.664340 14548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:54.666363 14533 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:37:54.666642 14533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "8b22e18987fa4c8ca3d61a76db5eadc2"
format_stamp: "Formatted at 2026-08-08 02:37:54 on dist-test-slave-8tdl"
server_key: "063f4d969eac645453f36ccfbe15fbb8"
server_key_iv: "d4d4632c8daddc62c8e9b00953e503a0"
server_key_version: "encryptionkey@0"
I20260808 02:37:54.666944 14533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:54.701236 14533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:54.708024 14533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:54.708442 14533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:54.709865 14533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:54.712059 14533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:54.712175 14533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:54.712316 14533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:54.712383 14533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:54.754603 14533 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:39817
I20260808 02:37:54.754735 14662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:39817 every 8 connection(s)
I20260808 02:37:54.756417 14533 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:54.762327 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14533
I20260808 02:37:54.762571 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:54.763083 10321 external_mini_cluster.cc:1428] Setting key 2c1567bcb4864e7e79d946e5943fd192
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:54.784869 14665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.759749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:45457 (local address 127.10.20.126:43913)
0808 02:37:54.760391 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:54.760398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:54.762241 (+ 1843us) server_negotiation.cc:407] Connection header received
0808 02:37:54.765153 (+ 2912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:54.765159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:54.765266 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:54.765424 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:54.767894 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.768847 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.771073 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.771737 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.771886 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.776604 (+ 4718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:54.776611 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:54.776614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:54.776655 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:54.780567 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.781851 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.781856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.781858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.782062 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.782666 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.782773 (+ 107us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.782786 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.783148 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:54.783302 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:54.784320 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0808 02:37:54.784562 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":341,"threads_started":1}
I20260808 02:37:54.786290 14666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.760658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:43913 (local address 127.10.20.67:45457)
0808 02:37:54.761920 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:54.761976 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:54.764754 (+ 2778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:54.765810 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:54.765829 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:54.766927 (+ 1098us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:54.767671 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:54.767695 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.769057 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.769062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:54.770892 (+ 1830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:54.770912 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.772021 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.772029 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:54.772365 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.773155 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:54.773184 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:54.776267 (+ 3083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:54.780791 (+ 4524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:54.780803 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:54.780824 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:54.781566 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:54.782221 (+ 655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:54.782225 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:54.782228 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:54.782481 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:54.783425 (+ 944us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:54.783432 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:54.783868 (+ 436us) client_negotiation.cc:769] Sending connection context
0808 02:37:54.784152 (+ 284us) client_negotiation.cc:240] Negotiation successful
0808 02:37:54.784632 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":593,"threads_started":1}
I20260808 02:37:54.790426 14663 heartbeater.cc:347] Connected to a master server at 127.10.20.126:43913
I20260808 02:37:54.791060 14663 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:54.792155 14663 heartbeater.cc:511] Master 127.10.20.126:43913 requested a full tablet report, sending...
I20260808 02:37:54.794174 14194 ts_manager.cc:194] Registered new tserver with Master: 8b22e18987fa4c8ca3d61a76db5eadc2 (127.10.20.67:39817)
I20260808 02:37:54.795339 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:37:54.795420 14194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:45457
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:54.870889 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.848095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42220 (local address 127.10.20.65:42699)
0808 02:37:54.848807 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:54.848815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:54.849048 (+ 233us) server_negotiation.cc:407] Connection header received
0808 02:37:54.849134 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:54.849141 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:54.849379 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:54.849536 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:54.851372 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.853041 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.854621 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.855605 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.855746 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.860980 (+ 5234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:54.861003 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:54.861021 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:54.861077 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:54.865231 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.866426 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.866436 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.866439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.866637 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.867899 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.867903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.867906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.868643 (+ 737us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:54.869167 (+ 524us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:54.870024 (+ 857us) server_negotiation.cc:299] Negotiation successful
0808 02:37:54.870295 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":364,"threads_started":1}
Aug 08 02:37:54 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:54.898869 14665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.878980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36498 (local address 127.10.20.126:43913)
0808 02:37:54.879702 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:54.879710 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:54.880189 (+ 479us) server_negotiation.cc:407] Connection header received
0808 02:37:54.880441 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:54.880446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:54.880560 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:54.880683 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:54.883241 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.884063 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.885459 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.885890 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.886048 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.892022 (+ 5974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:54.892034 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:54.892038 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:54.892088 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:54.895596 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.896523 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.896529 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.896531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.896685 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.897135 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.897140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.897142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.897528 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:54.897824 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:54.898193 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 02:37:54.898465 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540}
W20260808 02:37:54.899681 14194 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36498
I20260808 02:37:54.901511 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14255
I20260808 02:37:54.920616 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:54.902892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42224 (local address 127.10.20.65:42699)
0808 02:37:54.903145 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:54.903150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:54.903228 (+ 78us) server_negotiation.cc:407] Connection header received
0808 02:37:54.903544 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:54.903551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:54.903658 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:54.903811 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:54.905618 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.906459 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.907969 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:54.908480 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:54.908640 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:54.911590 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:54.911597 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:54.911601 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:54.911648 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:54.915092 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.916558 (+ 1466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.916563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.916566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.917017 (+ 451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:54.917808 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:54.917817 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:54.917823 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:54.918626 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:54.919208 (+ 582us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:54.919779 (+ 571us) server_negotiation.cc:299] Negotiation successful
0808 02:37:54.920197 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:37:54.921743 14382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:55.020987 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14255
I20260808 02:37:55.043749 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14394
Aug 08 02:37:55 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:37:55.064175 14676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:55.044963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43750 (local address 127.10.20.66:37127)
0808 02:37:55.045696 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:55.045704 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:55.045734 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:37:55.045814 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:55.045822 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:55.046136 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:55.046306 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:55.047932 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:55.049206 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:55.050782 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:55.051494 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:55.051621 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:55.056741 (+ 5120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:55.056781 (+ 40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:55.056801 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:55.056858 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:55.060655 (+ 3797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:55.061683 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:55.061694 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:55.061696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:55.061884 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:55.062345 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:55.062349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:55.062351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:55.062840 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:55.063193 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:55.063445 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 02:37:55.063683 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":396,"threads_started":1}
I20260808 02:37:55.065670 14522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:55.153625 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14394
I20260808 02:37:55.173302 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14533
Aug 08 02:37:55 dist-test-slave-8tdl krb5kdc[14145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:37:55.193622 14678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:55.174487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32996 (local address 127.10.20.67:39817)
0808 02:37:55.175143 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:55.175151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:55.175185 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:37:55.175254 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:55.175260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:55.175550 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:55.175772 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:55.177237 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:55.178282 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:55.179935 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:55.180564 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:55.180723 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:55.185860 (+ 5137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:55.185880 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:55.185898 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:55.185947 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:55.189747 (+ 3800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:55.190762 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:55.190777 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:55.190784 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:55.190980 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:55.191427 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:55.191433 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:55.191437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:55.191908 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:55.192271 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:55.192664 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 02:37:55.193008 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":330,"threads_started":1}
I20260808 02:37:55.195256 14658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:55.284729 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14533
I20260808 02:37:55.304023 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14158
I20260808 02:37:55.305579 14224 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:55.419559 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14158
2026-08-08T02:37:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4844 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:37:55 dist-test-slave-8tdl krb5kdc[14683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:37:55 dist-test-slave-8tdl krb5kdc[14683](info): set up 2 sockets
Aug 08 02:37:55 dist-test-slave-8tdl krb5kdc[14683](info): commencing operation
krb5kdc: starting...
W20260808 02:37:56.636368 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.005s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:37:56 dist-test-slave-8tdl krb5kdc[14683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:37:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:37:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:37:56.950081 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:38941
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:38941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:57.324765 14696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:57.325192 14696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:57.325351 14696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:57.333951 14696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:37:57.334161 14696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:57.334270 14696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:57.334357 14696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:37:57.334430 14696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:37:57.346920 14696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:38941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:38941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:57.348482 14696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:57.350100 14696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:57.366243 14705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:57.366508 14702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:57.366261 14703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:57.366825 14696 server_base.cc:1034] running on GCE node
I20260808 02:37:57.368412 14696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:57.370309 14696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:57.373884 14696 hybrid_clock.cc:648] HybridClock initialized: now 1786156677373758 us; error 108 us; skew 500 ppm
I20260808 02:37:57.374456 14696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:57 dist-test-slave-8tdl krb5kdc[14683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156677, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:57.378978 14696 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:37:57.380657 14696 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:57.380785 14696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:57.381130 14696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:57.384940 14696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "ce1c73be80ba4423b982e299e9e1a5c3"
format_stamp: "Formatted at 2026-08-08 02:37:57 on dist-test-slave-8tdl"
server_key: "23a55d3619230ae228c01ac35fdd8175"
server_key_iv: "4f2c60e8822bc22f0c16320a589cdb6c"
server_key_version: "encryptionkey@0"
I20260808 02:37:57.385978 14696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "ce1c73be80ba4423b982e299e9e1a5c3"
format_stamp: "Formatted at 2026-08-08 02:37:57 on dist-test-slave-8tdl"
server_key: "23a55d3619230ae228c01ac35fdd8175"
server_key_iv: "4f2c60e8822bc22f0c16320a589cdb6c"
server_key_version: "encryptionkey@0"
I20260808 02:37:57.393827 14696 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 02:37:57.400799 14711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:57.403318 14696 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260808 02:37:57.403618 14696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "ce1c73be80ba4423b982e299e9e1a5c3"
format_stamp: "Formatted at 2026-08-08 02:37:57 on dist-test-slave-8tdl"
server_key: "23a55d3619230ae228c01ac35fdd8175"
server_key_iv: "4f2c60e8822bc22f0c16320a589cdb6c"
server_key_version: "encryptionkey@0"
I20260808 02:37:57.404040 14696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:57.431967 14696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:57.437587 14696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:57.437871 14696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:57.464509 14696 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:38941
I20260808 02:37:57.464483 14763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:38941 every 8 connection(s)
I20260808 02:37:57.466337 14696 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:37:57.471302 14764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:57.472746 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14696
I20260808 02:37:57.473018 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:37:57.474205 10321 external_mini_cluster.cc:1428] Setting key 098f771c330920c802ea30e975f7ab5f
I20260808 02:37:57.487767 14764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3: Bootstrap starting.
I20260808 02:37:57.493244 14764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:57.494990 14764 log.cc:824] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:37:57 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:57.499163 14764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3: No bootstrap required, opened a new log
I20260808 02:37:57.509760 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:57.477465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52560 (local address 127.10.20.126:38941)
0808 02:37:57.479060 (+ 1595us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:57.479084 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:57.479161 (+ 77us) server_negotiation.cc:407] Connection header received
0808 02:37:57.481641 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:57.481678 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:57.482572 (+ 894us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:57.483311 (+ 739us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:57.485870 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:57.488024 (+ 2154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:57.490846 (+ 2822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:57.491792 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:57.491993 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:57.498445 (+ 6452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:57.498461 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:57.498487 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:57.498544 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:57.503338 (+ 4794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:57.504405 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:57.504415 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:57.504432 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:57.504698 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:57.505222 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:57.505229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:57.505234 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:57.506149 (+ 915us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:57.506523 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:57.507315 (+ 792us) server_negotiation.cc:299] Negotiation successful
0808 02:37:57.507941 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1002,"thread_start_us":741,"threads_started":1}
I20260808 02:37:57.511891 14764 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38941 } }
I20260808 02:37:57.512495 14764 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:57.512627 14764 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1c73be80ba4423b982e299e9e1a5c3, State: Initialized, Role: FOLLOWER
I20260808 02:37:57.513430 14764 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38941 } }
I20260808 02:37:57.513801 14764 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:37:57.513965 14764 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:37:57.514168 14764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:57.516865 14764 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38941 } }
I20260808 02:37:57.517475 14764 leader_election.cc:302] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce1c73be80ba4423b982e299e9e1a5c3; no voters:
I20260808 02:37:57.518296 14764 leader_election.cc:288] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:37:57.518460 14769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:57.519295 14769 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [term 1 LEADER]: Becoming Leader. State: Replica: ce1c73be80ba4423b982e299e9e1a5c3, State: Running, Role: LEADER
I20260808 02:37:57.519925 14769 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38941 } }
I20260808 02:37:57.521224 14764 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:37:57.523738 14771 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce1c73be80ba4423b982e299e9e1a5c3. Latest consensus state: current_term: 1 leader_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38941 } } }
I20260808 02:37:57.524130 14771 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:57.523561 14770 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1c73be80ba4423b982e299e9e1a5c3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38941 } } }
I20260808 02:37:57.524350 14770 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:37:57.526435 14775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:37:57.533795 14775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:37:57.546149 14775 catalog_manager.cc:1347] Generated new cluster ID: 593cb86644bc4914ac88c6ee1e168679
I20260808 02:37:57.546316 14775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:37:57.568423 14775 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:37:57.570930 14775 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:37:57.582250 14775 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3: Generated new TSK 0
I20260808 02:37:57.583370 14775 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:37:57.662181 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38941
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:58.063491 14790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:58.063838 14790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:58.063952 14790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:58.072644 14790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:58.072791 14790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:58.072927 14790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:37:58.085404 14790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:58.087119 14790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:58.088663 14790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:58.103904 14797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:58.104071 14799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:58.104033 14796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:58.104768 14790 server_base.cc:1034] running on GCE node
I20260808 02:37:58.105495 14790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:58.106769 14790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:58.108047 14790 hybrid_clock.cc:648] HybridClock initialized: now 1786156678107972 us; error 71 us; skew 500 ppm
I20260808 02:37:58.108459 14790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:58 dist-test-slave-8tdl krb5kdc[14683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156678, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:58.117501 14790 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:37:58.119094 14790 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:58.119220 14790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:58.119517 14790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:58.123123 14790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "aff6af813b844980a0af82cd7d71f5a2"
format_stamp: "Formatted at 2026-08-08 02:37:58 on dist-test-slave-8tdl"
server_key: "af5e67ad390a696d9b4118ecf9533104"
server_key_iv: "357868797a2e6906172d21d30a98d892"
server_key_version: "encryptionkey@0"
I20260808 02:37:58.124086 14790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "aff6af813b844980a0af82cd7d71f5a2"
format_stamp: "Formatted at 2026-08-08 02:37:58 on dist-test-slave-8tdl"
server_key: "af5e67ad390a696d9b4118ecf9533104"
server_key_iv: "357868797a2e6906172d21d30a98d892"
server_key_version: "encryptionkey@0"
I20260808 02:37:58.130350 14790 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:37:58.134817 14805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:58.136649 14790 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:37:58.136848 14790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "aff6af813b844980a0af82cd7d71f5a2"
format_stamp: "Formatted at 2026-08-08 02:37:58 on dist-test-slave-8tdl"
server_key: "af5e67ad390a696d9b4118ecf9533104"
server_key_iv: "357868797a2e6906172d21d30a98d892"
server_key_version: "encryptionkey@0"
I20260808 02:37:58.137076 14790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:58.163810 14790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:58.168939 14790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:58.169217 14790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:58.170301 14790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:58.171929 14790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:58.172039 14790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:58.172122 14790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:58.172180 14790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:58.210976 14790 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:34991
I20260808 02:37:58.211081 14917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:34991 every 8 connection(s)
I20260808 02:37:58.211966 14790 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:37:58.215057 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14790
I20260808 02:37:58.215399 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:37:58.216126 10321 external_mini_cluster.cc:1428] Setting key 85744d8713204347b16b32c6d3791b2e
Aug 08 02:37:58 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156678, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:58.235854 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:58.215121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:46311 (local address 127.10.20.126:38941)
0808 02:37:58.215663 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:58.215672 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:58.216830 (+ 1158us) server_negotiation.cc:407] Connection header received
0808 02:37:58.219128 (+ 2298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:58.219134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:58.219235 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:58.219354 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:58.221084 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.221891 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.224241 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.224728 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.224887 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:58.229213 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:58.229219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:58.229222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:58.229261 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:58.232132 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:58.233106 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:58.233111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:58.233113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:58.233251 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:58.233751 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:58.233761 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:58.233763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:58.234076 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:58.234243 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:58.235140 (+ 897us) server_negotiation.cc:299] Negotiation successful
0808 02:37:58.235450 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":259,"threads_started":1}
I20260808 02:37:58.236948 14921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:58.215666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:38941 (local address 127.10.20.65:46311)
0808 02:37:58.216618 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:58.216685 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:58.218815 (+ 2130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:58.219621 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:58.219630 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:58.220213 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:58.220866 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:58.220886 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.222065 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.222069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:58.224013 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:58.224041 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.225113 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.225124 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:58.225364 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:58.226150 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:58.226177 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:58.228899 (+ 2722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:58.232332 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:58.232343 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:58.232365 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:58.232941 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:58.233379 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:58.233384 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:58.233388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:58.233618 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:58.234219 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:58.234228 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:58.234631 (+ 403us) client_negotiation.cc:769] Sending connection context
0808 02:37:58.235007 (+ 376us) client_negotiation.cc:240] Negotiation successful
0808 02:37:58.235662 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":450,"threads_started":1}
I20260808 02:37:58.238951 14918 heartbeater.cc:347] Connected to a master server at 127.10.20.126:38941
I20260808 02:37:58.239377 14918 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:58.240118 14918 heartbeater.cc:511] Master 127.10.20.126:38941 requested a full tablet report, sending...
I20260808 02:37:58.242952 14728 ts_manager.cc:194] Registered new tserver with Master: aff6af813b844980a0af82cd7d71f5a2 (127.10.20.65:34991)
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:37:58.244789 14728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:46311
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:37:58.283679 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38941
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:37:58.675879 14924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:58.676234 14924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:58.676409 14924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:58.684211 14924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:58.684358 14924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:58.684554 14924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:37:58.695920 14924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:58.697513 14924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:58.699031 14924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:58.714089 14932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:58.714133 14934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:58.714324 14931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:58.715373 14924 server_base.cc:1034] running on GCE node
I20260808 02:37:58.716104 14924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:58.717216 14924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:58.718437 14924 hybrid_clock.cc:648] HybridClock initialized: now 1786156678718367 us; error 66 us; skew 500 ppm
I20260808 02:37:58.718834 14924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:58 dist-test-slave-8tdl krb5kdc[14683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156678, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:58.726557 14924 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:37:58.728245 14924 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:58.728369 14924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:58.728761 14924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:58.732373 14924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "24fd5bd0858e4930a2c413a6bbae643c"
format_stamp: "Formatted at 2026-08-08 02:37:58 on dist-test-slave-8tdl"
server_key: "d0ce77d492b1337d9b82b377d9e1db57"
server_key_iv: "fff551fc1755bb54e77a68ddd7538391"
server_key_version: "encryptionkey@0"
I20260808 02:37:58.733418 14924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "24fd5bd0858e4930a2c413a6bbae643c"
format_stamp: "Formatted at 2026-08-08 02:37:58 on dist-test-slave-8tdl"
server_key: "d0ce77d492b1337d9b82b377d9e1db57"
server_key_iv: "fff551fc1755bb54e77a68ddd7538391"
server_key_version: "encryptionkey@0"
I20260808 02:37:58.739959 14924 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:37:58.744669 14940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:58.746838 14924 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:37:58.747093 14924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "24fd5bd0858e4930a2c413a6bbae643c"
format_stamp: "Formatted at 2026-08-08 02:37:58 on dist-test-slave-8tdl"
server_key: "d0ce77d492b1337d9b82b377d9e1db57"
server_key_iv: "fff551fc1755bb54e77a68ddd7538391"
server_key_version: "encryptionkey@0"
I20260808 02:37:58.747380 14924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:58.766865 14924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:58.772449 14924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:58.772810 14924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:58.774091 14924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:58.775925 14924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:58.776075 14924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:58.776203 14924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:58.776337 14924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:58.818694 14924 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36845
I20260808 02:37:58.818813 15053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36845 every 8 connection(s)
I20260808 02:37:58.819746 14924 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:37:58.824780 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 14924
I20260808 02:37:58.825012 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:37:58.825482 10321 external_mini_cluster.cc:1428] Setting key fae45dfeb89b1957b1a8995df3cbf17d
Aug 08 02:37:58 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156678, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:58.847149 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:58.823711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:55689 (local address 127.10.20.126:38941)
0808 02:37:58.824277 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:58.824283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:58.825674 (+ 1391us) server_negotiation.cc:407] Connection header received
0808 02:37:58.828126 (+ 2452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:58.828131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:58.828221 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:58.828348 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:58.830220 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.831483 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.833410 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.834224 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.834388 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:58.839088 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:58.839094 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:58.839098 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:58.839142 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:58.842215 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:58.843687 (+ 1472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:58.843692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:58.843695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:58.843960 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:58.844663 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:58.844667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:58.844670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:58.845257 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:58.845418 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:58.846520 (+ 1102us) server_negotiation.cc:299] Negotiation successful
0808 02:37:58.846842 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":287,"threads_started":1}
I20260808 02:37:58.848827 15057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:58.824493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:38941 (local address 127.10.20.66:55689)
0808 02:37:58.825467 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:58.825527 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:58.827808 (+ 2281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:58.828661 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:58.828673 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:58.829302 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:58.829973 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:58.830000 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.831705 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.831710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:58.833213 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:58.833231 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:58.834530 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:58.834536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:58.834892 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:58.835693 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:58.835719 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:58.838678 (+ 2959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:58.842454 (+ 3776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:58.842473 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:58.842500 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:58.843419 (+ 919us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:58.844132 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:58.844141 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:58.844148 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:58.844485 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:58.845439 (+ 954us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:58.845453 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:58.846017 (+ 564us) client_negotiation.cc:769] Sending connection context
0808 02:37:58.846378 (+ 361us) client_negotiation.cc:240] Negotiation successful
0808 02:37:58.847167 (+ 789us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":427,"threads_started":1}
I20260808 02:37:58.850841 15054 heartbeater.cc:347] Connected to a master server at 127.10.20.126:38941
I20260808 02:37:58.851301 15054 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:58.852445 15054 heartbeater.cc:511] Master 127.10.20.126:38941 requested a full tablet report, sending...
I20260808 02:37:58.854331 14728 ts_manager.cc:194] Registered new tserver with Master: 24fd5bd0858e4930a2c413a6bbae643c (127.10.20.66:36845)
I20260808 02:37:58.855273 14728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:55689
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:37:58.896232 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38941
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:37:59.249235 14918 heartbeater.cc:503] Master 127.10.20.126:38941 was elected leader, sending a full tablet report...
W20260808 02:37:59.276111 15060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:37:59.276438 15060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:37:59.276543 15060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:37:59.284212 15060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:37:59.284363 15060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:37:59.284488 15060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:37:59.295241 15060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:37:59.296787 15060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:37:59.298300 15060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:37:59.313076 15069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:59.313123 15067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:37:59.313283 15065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:37:59.313813 15060 server_base.cc:1034] running on GCE node
I20260808 02:37:59.314579 15060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:37:59.315747 15060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:37:59.317036 15060 hybrid_clock.cc:648] HybridClock initialized: now 1786156679316984 us; error 45 us; skew 500 ppm
I20260808 02:37:59.317481 15060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:37:59 dist-test-slave-8tdl krb5kdc[14683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:37:59.321574 15060 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:37:59.323174 15060 fs_manager.cc:359] Metadata directory not provided
I20260808 02:37:59.323328 15060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:37:59.323700 15060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:37:59.327334 15060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7"
format_stamp: "Formatted at 2026-08-08 02:37:59 on dist-test-slave-8tdl"
server_key: "8b1f6a692a63637969d2cd7ca0bbacd2"
server_key_iv: "7afc55400eb2a9638289bef1ced841e4"
server_key_version: "encryptionkey@0"
I20260808 02:37:59.328341 15060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7"
format_stamp: "Formatted at 2026-08-08 02:37:59 on dist-test-slave-8tdl"
server_key: "8b1f6a692a63637969d2cd7ca0bbacd2"
server_key_iv: "7afc55400eb2a9638289bef1ced841e4"
server_key_version: "encryptionkey@0"
I20260808 02:37:59.334903 15060 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:37:59.339568 15075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:59.341426 15060 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:37:59.341650 15060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7"
format_stamp: "Formatted at 2026-08-08 02:37:59 on dist-test-slave-8tdl"
server_key: "8b1f6a692a63637969d2cd7ca0bbacd2"
server_key_iv: "7afc55400eb2a9638289bef1ced841e4"
server_key_version: "encryptionkey@0"
I20260808 02:37:59.341928 15060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:37:59.369336 15060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:37:59.374617 15060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:37:59.375123 15060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:37:59.376261 15060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:37:59.377897 15060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:37:59.378041 15060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:59.378172 15060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:37:59.378258 15060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:37:59.415294 15060 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:42331
I20260808 02:37:59.415359 15188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:42331 every 8 connection(s)
I20260808 02:37:59.416320 15060 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:37:59.419711 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15060
I20260808 02:37:59.419955 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:37:59.420405 10321 external_mini_cluster.cc:1428] Setting key a13540430049495343f8e7568a9186f8
Aug 08 02:37:59 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:37:59.441730 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.419261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:35895 (local address 127.10.20.126:38941)
0808 02:37:59.419826 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.419833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.421132 (+ 1299us) server_negotiation.cc:407] Connection header received
0808 02:37:59.423742 (+ 2610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.423748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.423878 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.424007 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:59.425941 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.426989 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.429037 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.429583 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.429713 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.434026 (+ 4313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:59.434032 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:59.434035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:59.434078 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:59.437774 (+ 3696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:59.438670 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:59.438718 (+ 48us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:59.438724 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:59.438869 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:59.439467 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:59.439471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:59.439473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:59.439803 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:59.439943 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.441179 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.441445 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":274,"threads_started":1}
I20260808 02:37:59.443009 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.419965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:38941 (local address 127.10.20.67:35895)
0808 02:37:59.420920 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:59.420976 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:59.423413 (+ 2437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:59.424380 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:59.424391 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:59.425009 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:37:59.425709 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.425730 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.427219 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.427223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.428810 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.428828 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.429912 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.429918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.430191 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.431073 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:37:59.431101 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:37:59.433711 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:37:59.437941 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:59.437950 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:59.437968 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:59.438548 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:59.439035 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:37:59.439040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:37:59.439043 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:37:59.439280 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:37:59.440034 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:37:59.440042 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:37:59.440570 (+ 528us) client_negotiation.cc:769] Sending connection context
0808 02:37:59.440887 (+ 317us) client_negotiation.cc:240] Negotiation successful
0808 02:37:59.441539 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":390,"threads_started":1}
I20260808 02:37:59.444721 15189 heartbeater.cc:347] Connected to a master server at 127.10.20.126:38941
I20260808 02:37:59.445164 15189 heartbeater.cc:464] Registering TS with master...
I20260808 02:37:59.445920 15189 heartbeater.cc:511] Master 127.10.20.126:38941 requested a full tablet report, sending...
I20260808 02:37:59.447896 14728 ts_manager.cc:194] Registered new tserver with Master: 80a8b9ab27554d6393ee20ab4ab8eeb7 (127.10.20.67:42331)
I20260808 02:37:59.449180 14728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:35895
I20260808 02:37:59.451031 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:37:59.473537 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.456601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52570 (local address 127.10.20.126:38941)
0808 02:37:59.456983 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.456993 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.457458 (+ 465us) server_negotiation.cc:407] Connection header received
0808 02:37:59.457617 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.457621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.457693 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.457781 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:59.459694 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.460731 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.462324 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.462843 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.463021 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.465866 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:59.465873 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:59.465879 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:59.465929 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:59.469991 (+ 4062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:59.471040 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:59.471046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:59.471050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:59.471253 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:59.471668 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:59.471673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:59.471677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:59.472189 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:59.472476 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.472906 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.473188 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260808 02:37:59.478978 14728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:37:59.487124 14728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:37:59.519970 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.502106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42288 (local address 127.10.20.67:42331)
0808 02:37:59.504073 (+ 1967us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.504085 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.506502 (+ 2417us) server_negotiation.cc:407] Connection header received
0808 02:37:59.506803 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.506816 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.507144 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.508917 (+ 1773us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:59.509477 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.511877 (+ 2400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.516389 (+ 4512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.518297 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.518460 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.518763 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.519266 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.519522 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1767,"thread_start_us":1574,"threads_started":1}
I20260808 02:37:59.520105 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.501325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:42331 (local address 127.0.0.1:42288)
0808 02:37:59.506334 (+ 5009us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:59.506361 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:59.506560 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:59.507532 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:59.507544 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:59.507590 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:59.508130 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.508151 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.512144 (+ 3993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.512154 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.516059 (+ 3905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.516090 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.518584 (+ 2494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.518590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.518977 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.519028 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 02:37:59.519179 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 02:37:59.519587 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4821,"mutex_wait_us":108,"thread_start_us":4597,"threads_started":1}
I20260808 02:37:59.521004 15203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.501226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36845 (local address 127.0.0.1:51714)
0808 02:37:59.503026 (+ 1800us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:59.503092 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:59.503294 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:59.508047 (+ 4753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:59.508056 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:59.508103 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:59.508735 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.508753 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.513663 (+ 4910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.513673 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.517044 (+ 3371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.517071 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.519902 (+ 2831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.519909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.520279 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.520315 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:37:59.520419 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:37:59.520581 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1378,"mutex_wait_us":1,"thread_start_us":1211,"threads_started":1}
I20260808 02:37:59.522225 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.501396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.10.20.66:36845)
0808 02:37:59.507251 (+ 5855us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.507264 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.507302 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:37:59.507427 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.507454 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.507752 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.510845 (+ 3093us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:59.511197 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.513395 (+ 2198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.518146 (+ 4751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.519603 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.521336 (+ 1733us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.521568 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.521648 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.521890 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5622,"thread_start_us":5488,"threads_started":1}
I20260808 02:37:59.524844 15123 tablet_service.cc:1467] Processing CreateTablet for tablet b5550ae39c9442a8859645c84e9c2ee6 (DEFAULT_TABLE table=test-table [id=5c14da12aac34d4daa3793cf0f8c8788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:59.526665 15123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5550ae39c9442a8859645c84e9c2ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:59.527175 14989 tablet_service.cc:1467] Processing CreateTablet for tablet b5550ae39c9442a8859645c84e9c2ee6 (DEFAULT_TABLE table=test-table [id=5c14da12aac34d4daa3793cf0f8c8788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:59.528905 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.504306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34991 (local address 127.0.0.1:48882)
0808 02:37:59.520900 (+ 16594us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:59.520922 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:59.521062 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:59.522177 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:59.522182 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:59.522217 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:59.522447 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.522461 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.524348 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.524354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.526101 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.526117 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.527877 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.527885 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.528224 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.528254 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 02:37:59.528374 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 02:37:59.528545 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16454,"thread_start_us":13682,"threads_started":1}
I20260808 02:37:59.528932 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.504696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48882 (local address 127.10.20.65:34991)
0808 02:37:59.517476 (+ 12780us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.517487 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.521054 (+ 3567us) server_negotiation.cc:407] Connection header received
0808 02:37:59.521332 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.521341 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.521624 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.521883 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:59.522643 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.524159 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.526338 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.527628 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.527799 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.528116 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.528439 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.528611 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12534,"thread_start_us":12781,"threads_started":1}
I20260808 02:37:59.528942 14989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5550ae39c9442a8859645c84e9c2ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:59.533131 14853 tablet_service.cc:1467] Processing CreateTablet for tablet b5550ae39c9442a8859645c84e9c2ee6 (DEFAULT_TABLE table=test-table [id=5c14da12aac34d4daa3793cf0f8c8788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:37:59.534729 14853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5550ae39c9442a8859645c84e9c2ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:37:59.543951 15209 tablet_bootstrap.cc:492] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Bootstrap starting.
I20260808 02:37:59.547639 15210 tablet_bootstrap.cc:492] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Bootstrap starting.
I20260808 02:37:59.549587 15209 tablet_bootstrap.cc:654] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:59.551607 15210 tablet_bootstrap.cc:654] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:59.551831 15209 log.cc:824] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:59.553118 15210 log.cc:824] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:59.554953 15211 tablet_bootstrap.cc:492] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Bootstrap starting.
I20260808 02:37:59.556036 15209 tablet_bootstrap.cc:492] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: No bootstrap required, opened a new log
I20260808 02:37:59.556375 15209 ts_tablet_manager.cc:1397] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260808 02:37:59.557364 15210 tablet_bootstrap.cc:492] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: No bootstrap required, opened a new log
I20260808 02:37:59.557664 15210 ts_tablet_manager.cc:1397] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:37:59.559129 15211 tablet_bootstrap.cc:654] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Neither blocks nor log segments found. Creating new log.
I20260808 02:37:59.560626 15211 log.cc:824] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:37:59.564482 15211 tablet_bootstrap.cc:492] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: No bootstrap required, opened a new log
I20260808 02:37:59.564836 15211 ts_tablet_manager.cc:1397] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 02:37:59.565951 15209 raft_consensus.cc:348] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.566385 15209 raft_consensus.cc:374] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:59.566488 15209 raft_consensus.cc:729] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a8b9ab27554d6393ee20ab4ab8eeb7, State: Initialized, Role: FOLLOWER
I20260808 02:37:59.567221 15209 consensus_queue.cc:260] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.568485 15189 heartbeater.cc:503] Master 127.10.20.126:38941 was elected leader, sending a full tablet report...
I20260808 02:37:59.568491 15210 raft_consensus.cc:348] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.568990 15210 raft_consensus.cc:374] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:59.569084 15210 raft_consensus.cc:729] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24fd5bd0858e4930a2c413a6bbae643c, State: Initialized, Role: FOLLOWER
I20260808 02:37:59.569245 15209 ts_tablet_manager.cc:1428] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 02:37:59.569904 15210 consensus_queue.cc:260] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.571193 15054 heartbeater.cc:503] Master 127.10.20.126:38941 was elected leader, sending a full tablet report...
I20260808 02:37:59.571916 15210 ts_tablet_manager.cc:1428] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
W20260808 02:37:59.572697 15055 tablet.cc:2369] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:59.576011 15211 raft_consensus.cc:348] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.576581 15211 raft_consensus.cc:374] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:37:59.576728 15211 raft_consensus.cc:729] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff6af813b844980a0af82cd7d71f5a2, State: Initialized, Role: FOLLOWER
I20260808 02:37:59.577548 15211 consensus_queue.cc:260] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.579789 15211 ts_tablet_manager.cc:1428] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Time spent starting tablet: real 0.015s user 0.017s sys 0.000s
W20260808 02:37:59.668049 15190 tablet.cc:2369] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:37:59.714924 14919 tablet.cc:2369] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:37:59.826336 15215 raft_consensus.cc:482] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:37:59.826848 15215 raft_consensus.cc:504] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.828730 15215 leader_election.cc:288] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24fd5bd0858e4930a2c413a6bbae643c (127.10.20.66:36845), aff6af813b844980a0af82cd7d71f5a2 (127.10.20.65:34991)
I20260808 02:37:59.836885 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.829250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:59819 (local address 127.10.20.66:36845)
0808 02:37:59.829470 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.829476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.829499 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:37:59.829575 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.829581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.829659 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.829770 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:59.830423 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.831628 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.834311 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.835823 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.836023 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.836092 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.836532 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.836652 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:37:59.836939 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.828965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36845 (local address 127.10.20.67:59819)
0808 02:37:59.829207 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:59.829230 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:59.829365 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:59.829972 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:59.829978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:59.830012 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:59.830244 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.830257 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.831800 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.831807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.834067 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.834085 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.836054 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.836061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.836274 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.836313 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:37:59.836437 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 02:37:59.836600 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":109}
I20260808 02:37:59.838550 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.830219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44993 (local address 127.10.20.65:34991)
0808 02:37:59.830482 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.830487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.830503 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:37:59.830563 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.830574 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.830635 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.830814 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:37:59.831652 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.832989 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.836035 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.837368 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.837586 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.837644 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.838056 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.838211 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 02:37:59.838455 15218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.829381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34991 (local address 127.10.20.67:44993)
0808 02:37:59.830159 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0808 02:37:59.830182 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:37:59.830312 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:37:59.830850 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:37:59.830856 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:37:59.830888 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:37:59.831418 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.831438 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.833207 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.833211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.835732 (+ 2521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:37:59.835754 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.837655 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.837662 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:37:59.837858 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.837885 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 02:37:59.837970 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 02:37:59.838097 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":98,"thread_start_us":442,"threads_started":1}
I20260808 02:37:59.838474 15009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5550ae39c9442a8859645c84e9c2ee6" candidate_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24fd5bd0858e4930a2c413a6bbae643c" is_pre_election: true
I20260808 02:37:59.839226 15009 raft_consensus.cc:2454] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80a8b9ab27554d6393ee20ab4ab8eeb7 in term 0.
I20260808 02:37:59.840029 15076 leader_election.cc:302] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24fd5bd0858e4930a2c413a6bbae643c, 80a8b9ab27554d6393ee20ab4ab8eeb7; no voters:
I20260808 02:37:59.840247 14873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5550ae39c9442a8859645c84e9c2ee6" candidate_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff6af813b844980a0af82cd7d71f5a2" is_pre_election: true
I20260808 02:37:59.840582 15215 raft_consensus.cc:2781] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:37:59.840806 15215 raft_consensus.cc:482] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:37:59.840932 15215 raft_consensus.cc:3037] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:59.840974 14873 raft_consensus.cc:2454] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80a8b9ab27554d6393ee20ab4ab8eeb7 in term 0.
I20260808 02:37:59.843791 15215 raft_consensus.cc:504] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.844595 15215 leader_election.cc:288] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [CANDIDATE]: Term 1 election: Requested vote from peers 24fd5bd0858e4930a2c413a6bbae643c (127.10.20.66:36845), aff6af813b844980a0af82cd7d71f5a2 (127.10.20.65:34991)
I20260808 02:37:59.845249 14873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5550ae39c9442a8859645c84e9c2ee6" candidate_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff6af813b844980a0af82cd7d71f5a2"
I20260808 02:37:59.845289 15009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5550ae39c9442a8859645c84e9c2ee6" candidate_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24fd5bd0858e4930a2c413a6bbae643c"
I20260808 02:37:59.845510 14873 raft_consensus.cc:3037] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:59.845559 15009 raft_consensus.cc:3037] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:37:59.848311 14873 raft_consensus.cc:2454] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80a8b9ab27554d6393ee20ab4ab8eeb7 in term 1.
I20260808 02:37:59.848481 15009 raft_consensus.cc:2454] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80a8b9ab27554d6393ee20ab4ab8eeb7 in term 1.
I20260808 02:37:59.848937 15076 leader_election.cc:302] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80a8b9ab27554d6393ee20ab4ab8eeb7, aff6af813b844980a0af82cd7d71f5a2; no voters:
I20260808 02:37:59.849475 15215 raft_consensus.cc:2781] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:37:59.850019 15215 raft_consensus.cc:686] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 1 LEADER]: Becoming Leader. State: Replica: 80a8b9ab27554d6393ee20ab4ab8eeb7, State: Running, Role: LEADER
I20260808 02:37:59.850596 15215 consensus_queue.cc:237] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } }
I20260808 02:37:59.856912 14727 catalog_manager.cc:5495] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80a8b9ab27554d6393ee20ab4ab8eeb7 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80a8b9ab27554d6393ee20ab4ab8eeb7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 42331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 } health_report { overall_health: UNKNOWN } } }
I20260808 02:37:59.896018 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.889692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42292 (local address 127.10.20.67:42331)
0808 02:37:59.890088 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.890094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.890119 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:37:59.890338 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.890343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.890446 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.890623 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:37:59.891080 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.891829 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.893504 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.893946 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.894099 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.894725 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:37:59.895301 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:37:59.895491 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.895618 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.895719 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 02:37:59.906096 14873 raft_consensus.cc:1261] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 1 FOLLOWER]: Refusing update from remote peer 80a8b9ab27554d6393ee20ab4ab8eeb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:59.906096 15009 raft_consensus.cc:1261] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 1 FOLLOWER]: Refusing update from remote peer 80a8b9ab27554d6393ee20ab4ab8eeb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:37:59.907676 15215 consensus_queue.cc:1035] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff6af813b844980a0af82cd7d71f5a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:59.908120 15219 consensus_queue.cc:1035] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24fd5bd0858e4930a2c413a6bbae643c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:37:59.938189 14728 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:59.938581 14728 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:37:59.943470 14728 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce1c73be80ba4423b982e299e9e1a5c3: Sending DeleteTablet for 3 replicas of tablet b5550ae39c9442a8859645c84e9c2ee6
I20260808 02:37:59.944914 14989 tablet_service.cc:1514] Processing DeleteTablet for tablet b5550ae39c9442a8859645c84e9c2ee6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:59 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:51714
I20260808 02:37:59.944938 15123 tablet_service.cc:1514] Processing DeleteTablet for tablet b5550ae39c9442a8859645c84e9c2ee6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:59 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:42288
I20260808 02:37:59.946556 14853 tablet_service.cc:1514] Processing DeleteTablet for tablet b5550ae39c9442a8859645c84e9c2ee6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:37:59 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:48882
I20260808 02:37:59.947413 15232 tablet_replica.cc:330] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: stopping tablet replica
I20260808 02:37:59.947774 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14790
I20260808 02:37:59.947952 15232 raft_consensus.cc:2229] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:37:59.948731 15232 raft_consensus.cc:2258] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:59.949627 15234 tablet_replica.cc:330] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: stopping tablet replica
I20260808 02:37:59.950122 15234 raft_consensus.cc:2229] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:59.950755 15234 raft_consensus.cc:2258] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:37:59.952916 15232 ts_tablet_manager.cc:1905] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:59.952916 15234 ts_tablet_manager.cc:1905] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:59.962532 15234 ts_tablet_manager.cc:1918] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:37:59.962833 15234 log.cc:1196] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/b5550ae39c9442a8859645c84e9c2ee6
I20260808 02:37:59.963567 15234 ts_tablet_manager.cc:1939] T b5550ae39c9442a8859645c84e9c2ee6 P aff6af813b844980a0af82cd7d71f5a2: Deleting consensus metadata
I20260808 02:37:59.964303 15233 tablet_replica.cc:330] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: stopping tablet replica
I20260808 02:37:59.964927 15233 raft_consensus.cc:2229] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:37:59.965673 15233 raft_consensus.cc:2258] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 02:37:59 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:37:59.966030 14712 catalog_manager.cc:4841] TS aff6af813b844980a0af82cd7d71f5a2 (127.10.20.65:34991): tablet b5550ae39c9442a8859645c84e9c2ee6 (table test-table [id=5c14da12aac34d4daa3793cf0f8c8788]) successfully deleted
I20260808 02:37:59.968570 15233 ts_tablet_manager.cc:1905] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:37:59.970510 15232 ts_tablet_manager.cc:1918] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:37:59.970783 15232 log.cc:1196] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/b5550ae39c9442a8859645c84e9c2ee6
I20260808 02:37:59.971501 15232 ts_tablet_manager.cc:1939] T b5550ae39c9442a8859645c84e9c2ee6 P 80a8b9ab27554d6393ee20ab4ab8eeb7: Deleting consensus metadata
I20260808 02:37:59.973887 14714 catalog_manager.cc:4841] TS 80a8b9ab27554d6393ee20ab4ab8eeb7 (127.10.20.67:42331): tablet b5550ae39c9442a8859645c84e9c2ee6 (table test-table [id=5c14da12aac34d4daa3793cf0f8c8788]) successfully deleted
I20260808 02:37:59.976979 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:37:59.950384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.10.20.65:34991)
0808 02:37:59.950575 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:37:59.950583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:37:59.950604 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:37:59.950665 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:37:59.950669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:37:59.950788 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:37:59.950909 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:37:59.953475 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.955162 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.958182 (+ 3020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:37:59.959219 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:37:59.959384 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:37:59.967760 (+ 8376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:37:59.967780 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:37:59.967800 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:37:59.967856 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:37:59.972606 (+ 4750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:59.973809 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:59.973819 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:59.973822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:59.974049 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:37:59.974765 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:37:59.974772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:37:59.974777 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:37:59.975416 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:37:59.975975 (+ 559us) server_negotiation.cc:1035] Waiting for connection context
0808 02:37:59.976187 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 02:37:59.976496 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:37:59.977923 14913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:37:59.979408 15233 ts_tablet_manager.cc:1918] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:37:59.979673 15233 log.cc:1196] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/b5550ae39c9442a8859645c84e9c2ee6
I20260808 02:37:59.980412 15233 ts_tablet_manager.cc:1939] T b5550ae39c9442a8859645c84e9c2ee6 P 24fd5bd0858e4930a2c413a6bbae643c: Deleting consensus metadata
I20260808 02:37:59.983417 14712 catalog_manager.cc:4841] TS 24fd5bd0858e4930a2c413a6bbae643c (127.10.20.66:36845): tablet b5550ae39c9442a8859645c84e9c2ee6 (table test-table [id=5c14da12aac34d4daa3793cf0f8c8788]) successfully deleted
I20260808 02:38:00.104082 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14790
I20260808 02:38:00.125522 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14924
Aug 08 02:38:00 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:38:00.146719 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:00.126426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51728 (local address 127.10.20.66:36845)
0808 02:38:00.126607 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:00.126612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:00.126727 (+ 115us) server_negotiation.cc:407] Connection header received
0808 02:38:00.127147 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:00.127153 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:00.127294 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:00.127653 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:00.129435 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:00.130257 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:00.132178 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:00.132810 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:00.133049 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:00.138619 (+ 5570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:00.138651 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:00.138709 (+ 58us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:00.138792 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:00.142912 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:00.143933 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:00.143945 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:00.143948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:00.144144 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:00.144686 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:00.144691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:00.144693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:00.145262 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:00.145538 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:00.145988 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 02:38:00.146196 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:38:00.147521 15049 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:00.244777 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14924
I20260808 02:38:00.272856 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15060
Aug 08 02:38:00 dist-test-slave-8tdl krb5kdc[14683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:38:00.294484 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:00.273705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42298 (local address 127.10.20.67:42331)
0808 02:38:00.273921 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:00.273926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:00.273949 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:38:00.274222 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:00.274227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:00.274312 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:00.274408 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:00.276404 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:00.277438 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:00.279796 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:00.280368 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:00.280512 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:00.286790 (+ 6278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:00.286811 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:00.286829 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:00.286891 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:00.290766 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:00.291779 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:00.291788 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:00.291791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:00.292016 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:00.292506 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:00.292511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:00.292513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:00.292907 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:00.293361 (+ 454us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:00.293725 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:38:00.294032 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:38:00.295349 15184 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:00.431911 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15060
I20260808 02:38:00.457590 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 14696
I20260808 02:38:00.459152 14759 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:00.580554 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 14696
2026-08-08T02:38:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5163 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T02:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:00Z Disabled control of system clock
I20260808 02:38:00.677315 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:34275
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:34275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 02:38:01.054939 15244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:01.055303 15244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:01.055471 15244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:01.064339 15244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:01.064502 15244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:01.064667 15244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:01.064813 15244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:01.064890 15244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:01.077593 15244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:34275
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:34275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:01.079260 15244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:01.081835 15244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:01.096472 15249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:01.096482 15250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:01.097680 15252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:01.098928 15244 server_base.cc:1034] running on GCE node
I20260808 02:38:01.099970 15244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:01.101787 15244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:01.103103 15244 hybrid_clock.cc:648] HybridClock initialized: now 1786156681103064 us; error 69 us; skew 500 ppm
I20260808 02:38:01.103570 15244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:01.106683 15244 webserver.cc:460] Webserver started at http://127.10.20.126:46185/ using document root <none> and password file <none>
I20260808 02:38:01.107612 15244 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:01.107766 15244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:01.108150 15244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:01.111593 15244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "127ccf6da3b74046b4d7c813c731caaa"
format_stamp: "Formatted at 2026-08-08 02:38:01 on dist-test-slave-8tdl"
server_key: "e505fd5316de69ce7ec40cfab9a385c1"
server_key_iv: "38b4712ffb7cf1b825765a06154cb4b1"
server_key_version: "encryptionkey@0"
I20260808 02:38:01.112623 15244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "127ccf6da3b74046b4d7c813c731caaa"
format_stamp: "Formatted at 2026-08-08 02:38:01 on dist-test-slave-8tdl"
server_key: "e505fd5316de69ce7ec40cfab9a385c1"
server_key_iv: "38b4712ffb7cf1b825765a06154cb4b1"
server_key_version: "encryptionkey@0"
I20260808 02:38:01.119767 15244 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:38:01.124310 15258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:01.126114 15244 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:38:01.126374 15244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "127ccf6da3b74046b4d7c813c731caaa"
format_stamp: "Formatted at 2026-08-08 02:38:01 on dist-test-slave-8tdl"
server_key: "e505fd5316de69ce7ec40cfab9a385c1"
server_key_iv: "38b4712ffb7cf1b825765a06154cb4b1"
server_key_version: "encryptionkey@0"
I20260808 02:38:01.126673 15244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:01.133545 15244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:01.134578 15244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:01.135004 15244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:01.156571 15244 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:34275
I20260808 02:38:01.156617 15309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:34275 every 8 connection(s)
I20260808 02:38:01.158205 15244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:01.162724 15310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:01.168452 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15244
I20260808 02:38:01.168694 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:01.169582 10321 external_mini_cluster.cc:1428] Setting key cf2fd7793cf443e454ee26d09389afeb
I20260808 02:38:01.176800 15310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa: Bootstrap starting.
I20260808 02:38:01.181236 15313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:01.172133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.10.20.126:34275)
0808 02:38:01.173435 (+ 1302us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:01.173449 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:01.173502 (+ 53us) server_negotiation.cc:407] Connection header received
0808 02:38:01.175650 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:01.175681 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:01.176240 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:01.177551 (+ 1311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:01.179282 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:01.179289 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:01.179305 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:01.179330 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:01.179402 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:01.179428 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:01.179738 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:01.179910 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 02:38:01.180222 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":517,"threads_started":1}
I20260808 02:38:01.181762 15310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:01.183220 15310 log.cc:824] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:01.186920 15310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa: No bootstrap required, opened a new log
I20260808 02:38:01.196259 15310 raft_consensus.cc:348] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127ccf6da3b74046b4d7c813c731caaa" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 34275 } }
I20260808 02:38:01.196782 15310 raft_consensus.cc:374] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:01.196913 15310 raft_consensus.cc:729] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 127ccf6da3b74046b4d7c813c731caaa, State: Initialized, Role: FOLLOWER
I20260808 02:38:01.197577 15310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127ccf6da3b74046b4d7c813c731caaa" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 34275 } }
I20260808 02:38:01.197880 15310 raft_consensus.cc:388] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:01.198043 15310 raft_consensus.cc:482] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:01.198258 15310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:01.201012 15310 raft_consensus.cc:504] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127ccf6da3b74046b4d7c813c731caaa" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 34275 } }
I20260808 02:38:01.201614 15310 leader_election.cc:302] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 127ccf6da3b74046b4d7c813c731caaa; no voters:
I20260808 02:38:01.202328 15310 leader_election.cc:288] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:01.202582 15315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:01.203408 15315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [term 1 LEADER]: Becoming Leader. State: Replica: 127ccf6da3b74046b4d7c813c731caaa, State: Running, Role: LEADER
I20260808 02:38:01.204152 15315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127ccf6da3b74046b4d7c813c731caaa" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 34275 } }
I20260808 02:38:01.204846 15310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:01.208297 15318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 127ccf6da3b74046b4d7c813c731caaa. Latest consensus state: current_term: 1 leader_uuid: "127ccf6da3b74046b4d7c813c731caaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127ccf6da3b74046b4d7c813c731caaa" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 34275 } } }
I20260808 02:38:01.208401 15317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "127ccf6da3b74046b4d7c813c731caaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127ccf6da3b74046b4d7c813c731caaa" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 34275 } } }
I20260808 02:38:01.208806 15318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:01.209132 15317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:01.211509 15322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:01.220647 15322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:01.233471 15322 catalog_manager.cc:1347] Generated new cluster ID: 877113a056e8461eb4669963e7c14a7c
I20260808 02:38:01.233734 15322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:01.248214 15322 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:01.248883 15322 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:01.267602 15322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa: Generated new TSK 0
I20260808 02:38:01.268908 15322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:38:01.274621 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:34275
--builtin_ntp_servers=127.10.20.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 02:38:01.671579 15335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:01.671942 15335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:01.672120 15335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:01.680845 15335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:01.680989 15335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:01.681201 15335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:01.693084 15335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:34275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:01.694885 15335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:01.697079 15335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:01.714977 15341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:01.715103 15343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:01.715507 15340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:01.716580 15335 server_base.cc:1034] running on GCE node
I20260808 02:38:01.717550 15335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:01.719041 15335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:01.720346 15335 hybrid_clock.cc:648] HybridClock initialized: now 1786156681720272 us; error 71 us; skew 500 ppm
I20260808 02:38:01.720892 15335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:01.725801 15335 webserver.cc:460] Webserver started at http://127.10.20.65:33685/ using document root <none> and password file <none>
I20260808 02:38:01.727162 15335 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:01.727339 15335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:01.727816 15335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:01.732920 15335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "a0fcdf5bbaba40fc9753186625135c5c"
format_stamp: "Formatted at 2026-08-08 02:38:01 on dist-test-slave-8tdl"
server_key: "1bd6acdc5d9b3786be727f00f61650c1"
server_key_iv: "e63cd0a2786efeb5705b9c90e46287ca"
server_key_version: "encryptionkey@0"
I20260808 02:38:01.733991 15335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "a0fcdf5bbaba40fc9753186625135c5c"
format_stamp: "Formatted at 2026-08-08 02:38:01 on dist-test-slave-8tdl"
server_key: "1bd6acdc5d9b3786be727f00f61650c1"
server_key_iv: "e63cd0a2786efeb5705b9c90e46287ca"
server_key_version: "encryptionkey@0"
I20260808 02:38:01.742061 15335 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.005s
I20260808 02:38:01.747239 15349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:01.749544 15335 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:38:01.749804 15335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "a0fcdf5bbaba40fc9753186625135c5c"
format_stamp: "Formatted at 2026-08-08 02:38:01 on dist-test-slave-8tdl"
server_key: "1bd6acdc5d9b3786be727f00f61650c1"
server_key_iv: "e63cd0a2786efeb5705b9c90e46287ca"
server_key_version: "encryptionkey@0"
I20260808 02:38:01.750093 15335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:01.757997 15335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:01.759511 15335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:01.759877 15335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:01.761157 15335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:01.763250 15335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:01.763392 15335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:01.763597 15335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:01.763688 15335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:01.803661 15335 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:44303
I20260808 02:38:01.803730 15465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:44303 every 8 connection(s)
I20260808 02:38:01.805325 15335 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:01.808933 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15335
I20260808 02:38:01.809227 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:38:01.810081 10321 external_mini_cluster.cc:1428] Setting key 31fc86f677b11dac9458552adc3c7aeb
I20260808 02:38:01.813194 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:34275
--builtin_ntp_servers=127.10.20.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 02:38:01.816351 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:01.809003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:38925 (local address 127.10.20.126:34275)
0808 02:38:01.809687 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:01.809696 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:01.811287 (+ 1591us) server_negotiation.cc:407] Connection header received
0808 02:38:01.813365 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:01.813374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:01.813460 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:01.813599 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:01.815373 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:01.815382 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:01.815390 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:01.815418 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:01.815491 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:01.815513 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:01.815662 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:01.815847 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 02:38:01.815926 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":342,"threads_started":1}
I20260808 02:38:01.817399 15469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:01.809744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:34275 (local address 127.10.20.65:38925)
0808 02:38:01.811116 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:01.811180 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:01.813038 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:01.813909 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:01.813920 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:01.814036 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:01.814909 (+ 873us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:01.814912 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:01.814957 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:01.815157 (+ 200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:01.815624 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:01.815632 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:01.815638 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:38:01.815895 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 02:38:01.816219 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":426,"threads_started":1}
I20260808 02:38:01.819242 15466 heartbeater.cc:347] Connected to a master server at 127.10.20.126:34275
I20260808 02:38:01.819643 15466 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:01.820493 15466 heartbeater.cc:511] Master 127.10.20.126:34275 requested a full tablet report, sending...
I20260808 02:38:01.823304 15275 ts_manager.cc:194] Registered new tserver with Master: a0fcdf5bbaba40fc9753186625135c5c (127.10.20.65:44303)
W20260808 02:38:02.202466 15470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:02.203478 15470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:02.203944 15470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:02.212306 15470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:02.212459 15470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:02.212641 15470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:02.222756 15470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:34275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:02.224674 15470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:02.227027 15470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:02.244442 15478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:02.244606 15475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:02.244491 15476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:02.244910 15470 server_base.cc:1034] running on GCE node
I20260808 02:38:02.245956 15470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:02.247468 15470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:02.248775 15470 hybrid_clock.cc:648] HybridClock initialized: now 1786156682248698 us; error 77 us; skew 500 ppm
I20260808 02:38:02.249184 15470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:02.252296 15470 webserver.cc:460] Webserver started at http://127.10.20.66:43833/ using document root <none> and password file <none>
I20260808 02:38:02.253152 15470 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:02.253306 15470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:02.253698 15470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:02.257303 15470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "57cbda898e0144ae9b764d0f745f818a"
format_stamp: "Formatted at 2026-08-08 02:38:02 on dist-test-slave-8tdl"
server_key: "59ae6397afec0d68faf018bd7f408724"
server_key_iv: "f16ef6ff8ea25bb0c4b5ac102aa0a755"
server_key_version: "encryptionkey@0"
I20260808 02:38:02.258289 15470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "57cbda898e0144ae9b764d0f745f818a"
format_stamp: "Formatted at 2026-08-08 02:38:02 on dist-test-slave-8tdl"
server_key: "59ae6397afec0d68faf018bd7f408724"
server_key_iv: "f16ef6ff8ea25bb0c4b5ac102aa0a755"
server_key_version: "encryptionkey@0"
I20260808 02:38:02.264992 15470 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:38:02.269770 15484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:02.271664 15470 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260808 02:38:02.271901 15470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "57cbda898e0144ae9b764d0f745f818a"
format_stamp: "Formatted at 2026-08-08 02:38:02 on dist-test-slave-8tdl"
server_key: "59ae6397afec0d68faf018bd7f408724"
server_key_iv: "f16ef6ff8ea25bb0c4b5ac102aa0a755"
server_key_version: "encryptionkey@0"
I20260808 02:38:02.272243 15470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:02.279143 15470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:02.280230 15470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:02.280553 15470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:02.281718 15470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:02.283502 15470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:02.283638 15470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:02.283780 15470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:02.283871 15470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:02.323125 15470 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:44655
I20260808 02:38:02.323225 15598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:44655 every 8 connection(s)
I20260808 02:38:02.324674 15470 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:02.327302 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15470
I20260808 02:38:02.327527 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:38:02.328106 10321 external_mini_cluster.cc:1428] Setting key 738449bd85c62742d0da3297556aad0e
I20260808 02:38:02.331992 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:34275
--builtin_ntp_servers=127.10.20.84:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 02:38:02.336589 15602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.328280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:40921 (local address 127.10.20.126:34275)
0808 02:38:02.328874 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:02.328881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:02.330537 (+ 1656us) server_negotiation.cc:407] Connection header received
0808 02:38:02.333486 (+ 2949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:02.333492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:02.333561 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:02.333677 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:02.335644 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:02.335650 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:02.335654 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:02.335677 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:02.335733 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:02.335749 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:02.335970 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:02.336233 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 02:38:02.336306 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":294,"threads_started":1}
I20260808 02:38:02.338059 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.329080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:34275 (local address 127.10.20.66:40921)
0808 02:38:02.330354 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:02.330419 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:02.333015 (+ 2596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:02.334030 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:02.334047 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:02.334213 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:02.335156 (+ 943us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:02.335162 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:02.335227 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:02.335370 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:02.335924 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:02.335938 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:02.335949 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 02:38:02.336283 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 02:38:02.336616 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":415,"threads_started":1}
I20260808 02:38:02.339928 15599 heartbeater.cc:347] Connected to a master server at 127.10.20.126:34275
I20260808 02:38:02.340375 15599 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:02.341341 15599 heartbeater.cc:511] Master 127.10.20.126:34275 requested a full tablet report, sending...
I20260808 02:38:02.343216 15275 ts_manager.cc:194] Registered new tserver with Master: 57cbda898e0144ae9b764d0f745f818a (127.10.20.66:44655)
W20260808 02:38:02.725639 15604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:02.725988 15604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:02.726120 15604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:02.734354 15604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:02.734488 15604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:02.734651 15604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:02.745163 15604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:34275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:02.747164 15604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:02.749614 15604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:02.766829 15612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:02.766924 15610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:02.766872 15609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:02.776582 15604 server_base.cc:1034] running on GCE node
I20260808 02:38:02.777585 15604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:02.779263 15604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:02.780623 15604 hybrid_clock.cc:648] HybridClock initialized: now 1786156682780532 us; error 69 us; skew 500 ppm
I20260808 02:38:02.781160 15604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:02.784191 15604 webserver.cc:460] Webserver started at http://127.10.20.67:32893/ using document root <none> and password file <none>
I20260808 02:38:02.785089 15604 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:02.785240 15604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:02.785602 15604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:02.788976 15604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "901622db84d44a39967874ec2aea1bd9"
format_stamp: "Formatted at 2026-08-08 02:38:02 on dist-test-slave-8tdl"
server_key: "54ab6ce1d14fd206caf81e98171f5712"
server_key_iv: "424580b9263a9f85c62577d10b97e58a"
server_key_version: "encryptionkey@0"
I20260808 02:38:02.789981 15604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "901622db84d44a39967874ec2aea1bd9"
format_stamp: "Formatted at 2026-08-08 02:38:02 on dist-test-slave-8tdl"
server_key: "54ab6ce1d14fd206caf81e98171f5712"
server_key_iv: "424580b9263a9f85c62577d10b97e58a"
server_key_version: "encryptionkey@0"
I20260808 02:38:02.796739 15604 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:38:02.801744 15618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:02.803740 15604 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:38:02.804050 15604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "901622db84d44a39967874ec2aea1bd9"
format_stamp: "Formatted at 2026-08-08 02:38:02 on dist-test-slave-8tdl"
server_key: "54ab6ce1d14fd206caf81e98171f5712"
server_key_iv: "424580b9263a9f85c62577d10b97e58a"
server_key_version: "encryptionkey@0"
I20260808 02:38:02.804363 15604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:02.811272 15604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:02.812299 15604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:02.812695 15604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:02.814009 15604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:02.815873 15604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:02.815999 15604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:02.816174 15604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:02.816264 15604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:02.827499 15466 heartbeater.cc:503] Master 127.10.20.126:34275 was elected leader, sending a full tablet report...
I20260808 02:38:02.855273 15604 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:45209
I20260808 02:38:02.855374 15733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:45209 every 8 connection(s)
I20260808 02:38:02.856815 15604 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:02.866328 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15604
I20260808 02:38:02.866585 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:38:02.867060 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.859929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:34567 (local address 127.10.20.126:34275)
0808 02:38:02.860646 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:02.860654 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:02.862179 (+ 1525us) server_negotiation.cc:407] Connection header received
0808 02:38:02.864202 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:02.864207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:02.864279 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:02.864398 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:02.866087 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:02.866093 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:02.866096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:02.866118 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:02.866170 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:02.866184 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:02.866313 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:02.866635 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 02:38:02.866756 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":247,"threads_started":1}
I20260808 02:38:02.867213 10321 external_mini_cluster.cc:1428] Setting key 7e8146cbfb65f82ce0d234b23d357d38
I20260808 02:38:02.868498 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.860777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:34275 (local address 127.10.20.67:34567)
0808 02:38:02.861921 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:02.861964 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:02.863822 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:02.864715 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:02.864738 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:02.864856 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:02.865634 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:02.865637 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:02.865684 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:02.865837 (+ 153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:02.866315 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:02.866329 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:02.866337 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 02:38:02.866713 (+ 376us) client_negotiation.cc:240] Negotiation successful
0808 02:38:02.867137 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":332,"threads_started":1}
I20260808 02:38:02.870129 15734 heartbeater.cc:347] Connected to a master server at 127.10.20.126:34275
I20260808 02:38:02.870532 15734 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:02.871332 15734 heartbeater.cc:511] Master 127.10.20.126:34275 requested a full tablet report, sending...
I20260808 02:38:02.872908 15275 ts_manager.cc:194] Registered new tserver with Master: 901622db84d44a39967874ec2aea1bd9 (127.10.20.67:45209)
I20260808 02:38:02.885288 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:38:02.894814 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.890967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51248 (local address 127.10.20.126:34275)
0808 02:38:02.891267 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:02.891272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:02.892062 (+ 790us) server_negotiation.cc:407] Connection header received
0808 02:38:02.892231 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:02.892235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:02.892297 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:02.892411 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:02.893732 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:02.893737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:02.893741 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:02.893760 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:02.893799 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:02.893815 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:02.893972 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:02.894321 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 02:38:02.894386 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260808 02:38:02.900110 15275 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:02.907845 15275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:02.937517 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.923164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42086)
0808 02:38:02.930912 (+ 7748us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:02.930981 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:02.931243 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:02.932370 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:02.932384 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:02.932542 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:02.934031 (+ 1489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:02.934037 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:02.934102 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:02.934246 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:02.936374 (+ 2128us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:02.936393 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:02.936410 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 02:38:02.936669 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 02:38:02.936809 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7341,"thread_start_us":12403,"threads_started":1}
I20260808 02:38:02.939494 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.923341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42086 (local address 127.10.20.65:44303)
0808 02:38:02.930299 (+ 6958us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:02.930310 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:02.931451 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 02:38:02.931571 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:02.931585 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:02.931950 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:02.934468 (+ 2518us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:02.935940 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:02.935949 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:02.935966 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:02.935989 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:02.936058 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:02.936081 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:02.936298 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:02.938274 (+ 1976us) server_negotiation.cc:299] Negotiation successful
0808 02:38:02.938450 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6673,"thread_start_us":6453,"threads_started":1}
I20260808 02:38:02.942293 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.923216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:45209 (local address 127.0.0.1:34618)
0808 02:38:02.935211 (+ 11995us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:02.935231 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:02.935325 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:02.936258 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:02.936267 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:02.936308 (+ 41us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:02.939293 (+ 2985us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:02.939297 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:02.939317 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:02.939377 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:02.941508 (+ 2131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:02.941513 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:02.941519 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:38:02.941677 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 02:38:02.941750 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11858,"thread_start_us":7047,"threads_started":1}
I20260808 02:38:02.943276 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.936346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.10.20.66:44655)
0808 02:38:02.940060 (+ 3714us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:02.940070 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:02.940105 (+ 35us) server_negotiation.cc:407] Connection header received
0808 02:38:02.940179 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:02.940188 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:02.940473 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:02.940670 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:02.942186 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:02.942194 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:02.942210 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:02.942245 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:02.942308 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:02.942332 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:02.942478 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:02.942790 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 02:38:02.942899 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3509,"thread_start_us":3371,"threads_started":1}
I20260808 02:38:02.943681 15751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.923889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34618 (local address 127.10.20.67:45209)
0808 02:38:02.935505 (+ 11616us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:02.935515 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:02.935561 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:38:02.935637 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:02.935646 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:02.935925 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:02.939866 (+ 3941us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:02.941193 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:02.941206 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:02.941224 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:02.941245 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:02.941309 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:02.941331 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:02.943070 (+ 1739us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:02.943145 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 02:38:02.943247 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11359,"thread_start_us":11487,"threads_started":1}
I20260808 02:38:02.943877 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:02.936024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:44655 (local address 127.0.0.1:49200)
0808 02:38:02.937873 (+ 1849us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:02.937901 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:02.938030 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:02.940850 (+ 2820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:02.940855 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:02.940901 (+ 46us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:02.941598 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:02.941602 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:02.941621 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:02.941685 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:02.942541 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:02.942549 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:02.942557 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 02:38:02.943502 (+ 945us) client_negotiation.cc:240] Negotiation successful
0808 02:38:02.943587 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1693,"thread_start_us":2990,"threads_started":1}
I20260808 02:38:02.944186 15398 tablet_service.cc:1467] Processing CreateTablet for tablet 2b179393924a4e75a727a498b652fa68 (DEFAULT_TABLE table=test-table [id=269fac37966743cebc0dd58d8c2b12cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:02.946206 15398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b179393924a4e75a727a498b652fa68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:02.947937 15533 tablet_service.cc:1467] Processing CreateTablet for tablet 2b179393924a4e75a727a498b652fa68 (DEFAULT_TABLE table=test-table [id=269fac37966743cebc0dd58d8c2b12cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:02.948213 15668 tablet_service.cc:1467] Processing CreateTablet for tablet 2b179393924a4e75a727a498b652fa68 (DEFAULT_TABLE table=test-table [id=269fac37966743cebc0dd58d8c2b12cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:02.949621 15533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b179393924a4e75a727a498b652fa68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:02.949872 15668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b179393924a4e75a727a498b652fa68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:02.964991 15754 tablet_bootstrap.cc:492] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Bootstrap starting.
I20260808 02:38:02.967525 15755 tablet_bootstrap.cc:492] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: Bootstrap starting.
I20260808 02:38:02.969609 15754 tablet_bootstrap.cc:654] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:02.969630 15756 tablet_bootstrap.cc:492] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Bootstrap starting.
I20260808 02:38:02.971366 15754 log.cc:824] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:02.972098 15755 tablet_bootstrap.cc:654] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:02.973688 15755 log.cc:824] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:02.974018 15756 tablet_bootstrap.cc:654] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:02.975466 15756 log.cc:824] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:02.976568 15754 tablet_bootstrap.cc:492] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: No bootstrap required, opened a new log
I20260808 02:38:02.976927 15754 ts_tablet_manager.cc:1397] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260808 02:38:02.977022 15755 tablet_bootstrap.cc:492] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: No bootstrap required, opened a new log
I20260808 02:38:02.977391 15755 ts_tablet_manager.cc:1397] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260808 02:38:02.979200 15756 tablet_bootstrap.cc:492] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: No bootstrap required, opened a new log
I20260808 02:38:02.979502 15756 ts_tablet_manager.cc:1397] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20260808 02:38:02.985963 15754 raft_consensus.cc:348] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:02.986483 15754 raft_consensus.cc:374] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:02.986603 15754 raft_consensus.cc:729] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57cbda898e0144ae9b764d0f745f818a, State: Initialized, Role: FOLLOWER
I20260808 02:38:02.987468 15754 consensus_queue.cc:260] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:02.988832 15599 heartbeater.cc:503] Master 127.10.20.126:34275 was elected leader, sending a full tablet report...
I20260808 02:38:02.988765 15755 raft_consensus.cc:348] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:02.989260 15755 raft_consensus.cc:374] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:02.989353 15755 raft_consensus.cc:729] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0fcdf5bbaba40fc9753186625135c5c, State: Initialized, Role: FOLLOWER
I20260808 02:38:02.989578 15754 ts_tablet_manager.cc:1428] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 02:38:02.990087 15755 consensus_queue.cc:260] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:02.991076 15756 raft_consensus.cc:348] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:02.991551 15756 raft_consensus.cc:374] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:02.991658 15756 raft_consensus.cc:729] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 901622db84d44a39967874ec2aea1bd9, State: Initialized, Role: FOLLOWER
I20260808 02:38:02.992197 15755 ts_tablet_manager.cc:1428] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260808 02:38:02.992363 15756 consensus_queue.cc:260] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:02.993687 15734 heartbeater.cc:503] Master 127.10.20.126:34275 was elected leader, sending a full tablet report...
I20260808 02:38:02.994448 15756 ts_tablet_manager.cc:1428] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Time spent starting tablet: real 0.015s user 0.008s sys 0.006s
W20260808 02:38:03.058326 15467 tablet.cc:2369] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:38:03.077205 15600 tablet.cc:2369] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:38:03.109079 15735 tablet.cc:2369] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:38:03.141619 15762 raft_consensus.cc:482] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:03.142068 15762 raft_consensus.cc:504] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:03.144035 15762 leader_election.cc:288] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0fcdf5bbaba40fc9753186625135c5c (127.10.20.65:44303), 57cbda898e0144ae9b764d0f745f818a (127.10.20.66:44655)
I20260808 02:38:03.147616 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.144432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.10.20.67:37097)
0808 02:38:03.144746 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.144772 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:03.144948 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:03.145542 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:03.145547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:03.145585 (+ 38us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:03.146435 (+ 850us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:03.146440 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:03.146463 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:03.146524 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:03.147106 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:03.147112 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:03.147118 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:38:03.147272 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 02:38:03.147338 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117}
I20260808 02:38:03.147727 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.144553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:37097 (local address 127.10.20.65:44303)
0808 02:38:03.144791 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:03.144800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:03.144853 (+ 53us) server_negotiation.cc:407] Connection header received
0808 02:38:03.145129 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:03.145136 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:03.145221 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:03.145371 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:03.146823 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:03.146833 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:03.146846 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:03.146876 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:03.146925 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:03.146946 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:03.147110 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:03.147292 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 02:38:03.147426 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:38:03.148321 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.145315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:52185 (local address 127.10.20.66:44655)
0808 02:38:03.145525 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:03.145532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:03.145899 (+ 367us) server_negotiation.cc:407] Connection header received
0808 02:38:03.146064 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:03.146070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:03.146131 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:03.146237 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:03.147487 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:03.147494 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:03.147499 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:03.147529 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:03.147578 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:03.147598 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:03.147733 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:03.147926 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 02:38:03.148006 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:38:03.148908 15419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b179393924a4e75a727a498b652fa68" candidate_uuid: "901622db84d44a39967874ec2aea1bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0fcdf5bbaba40fc9753186625135c5c" is_pre_election: true
I20260808 02:38:03.149226 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.144911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:44655 (local address 127.10.20.67:52185)
0808 02:38:03.145776 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.145802 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:03.145928 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:03.146314 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:03.146321 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:03.146354 (+ 33us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:03.147241 (+ 887us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:38:03.147244 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:03.147263 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:38:03.147310 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:03.147724 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:03.147732 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:03.147738 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 02:38:03.148621 (+ 883us) client_negotiation.cc:240] Negotiation successful
0808 02:38:03.148686 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":620,"threads_started":1}
I20260808 02:38:03.149660 15419 raft_consensus.cc:2454] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 901622db84d44a39967874ec2aea1bd9 in term 0.
I20260808 02:38:03.150648 15621 leader_election.cc:302] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 901622db84d44a39967874ec2aea1bd9, a0fcdf5bbaba40fc9753186625135c5c; no voters:
I20260808 02:38:03.150568 15553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b179393924a4e75a727a498b652fa68" candidate_uuid: "901622db84d44a39967874ec2aea1bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57cbda898e0144ae9b764d0f745f818a" is_pre_election: true
I20260808 02:38:03.151242 15762 raft_consensus.cc:2781] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:03.151276 15553 raft_consensus.cc:2454] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 901622db84d44a39967874ec2aea1bd9 in term 0.
I20260808 02:38:03.151419 15762 raft_consensus.cc:482] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:03.151564 15762 raft_consensus.cc:3037] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:03.154348 15762 raft_consensus.cc:504] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:03.155196 15762 leader_election.cc:288] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [CANDIDATE]: Term 1 election: Requested vote from peers a0fcdf5bbaba40fc9753186625135c5c (127.10.20.65:44303), 57cbda898e0144ae9b764d0f745f818a (127.10.20.66:44655)
I20260808 02:38:03.155901 15553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b179393924a4e75a727a498b652fa68" candidate_uuid: "901622db84d44a39967874ec2aea1bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57cbda898e0144ae9b764d0f745f818a"
I20260808 02:38:03.156020 15419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b179393924a4e75a727a498b652fa68" candidate_uuid: "901622db84d44a39967874ec2aea1bd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0fcdf5bbaba40fc9753186625135c5c"
I20260808 02:38:03.156160 15553 raft_consensus.cc:3037] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:03.156272 15419 raft_consensus.cc:3037] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:03.158728 15553 raft_consensus.cc:2454] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 901622db84d44a39967874ec2aea1bd9 in term 1.
I20260808 02:38:03.159296 15621 leader_election.cc:302] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57cbda898e0144ae9b764d0f745f818a, 901622db84d44a39967874ec2aea1bd9; no voters:
I20260808 02:38:03.159686 15762 raft_consensus.cc:2781] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:03.159787 15419 raft_consensus.cc:2454] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 901622db84d44a39967874ec2aea1bd9 in term 1.
I20260808 02:38:03.163172 15762 raft_consensus.cc:686] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 1 LEADER]: Becoming Leader. State: Replica: 901622db84d44a39967874ec2aea1bd9, State: Running, Role: LEADER
I20260808 02:38:03.163890 15762 consensus_queue.cc:237] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } }
I20260808 02:38:03.169512 15275 catalog_manager.cc:5495] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 901622db84d44a39967874ec2aea1bd9 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "901622db84d44a39967874ec2aea1bd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "901622db84d44a39967874ec2aea1bd9" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 } health_report { overall_health: UNKNOWN } } }
I20260808 02:38:03.185427 15751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.182556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34628 (local address 127.10.20.67:45209)
0808 02:38:03.182792 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:03.182796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:03.182817 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:38:03.183192 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:03.183197 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:03.183288 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:03.183399 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:03.184641 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:03.184646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:03.184650 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:03.184670 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:03.184710 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:03.184734 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:03.184893 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:03.185063 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 02:38:03.185141 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:38:03.196306 15553 raft_consensus.cc:1261] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 1 FOLLOWER]: Refusing update from remote peer 901622db84d44a39967874ec2aea1bd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:03.196316 15419 raft_consensus.cc:1261] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 1 FOLLOWER]: Refusing update from remote peer 901622db84d44a39967874ec2aea1bd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:03.197618 15762 consensus_queue.cc:1035] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57cbda898e0144ae9b764d0f745f818a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:03.198067 15764 consensus_queue.cc:1035] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0fcdf5bbaba40fc9753186625135c5c" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:03.227814 15275 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:03.228152 15275 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:03.232383 15275 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 127ccf6da3b74046b4d7c813c731caaa: Sending DeleteTablet for 3 replicas of tablet 2b179393924a4e75a727a498b652fa68
I20260808 02:38:03.233840 15668 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b179393924a4e75a727a498b652fa68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:03 UTC) from {username='slave'} at 127.0.0.1:34618
I20260808 02:38:03.234280 15398 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b179393924a4e75a727a498b652fa68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:03 UTC) from {username='slave'} at 127.0.0.1:42086
I20260808 02:38:03.234644 15533 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b179393924a4e75a727a498b652fa68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:03 UTC) from {username='slave'} at 127.0.0.1:49200
I20260808 02:38:03.237164 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15335
I20260808 02:38:03.246529 15779 tablet_replica.cc:330] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: stopping tablet replica
I20260808 02:38:03.247411 15779 raft_consensus.cc:2229] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:03.248301 15781 tablet_replica.cc:330] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: stopping tablet replica
I20260808 02:38:03.248584 15779 raft_consensus.cc:2258] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:03.250232 15781 raft_consensus.cc:2229] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:03.251072 15779 ts_tablet_manager.cc:1905] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:03.252472 15781 raft_consensus.cc:2258] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:03.254578 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.238692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.10.20.65:44303)
0808 02:38:03.238912 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:03.238920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:03.249162 (+ 10242us) server_negotiation.cc:407] Connection header received
0808 02:38:03.250838 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:03.250844 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:03.250978 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:03.251083 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:03.253612 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:03.253619 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:03.253624 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:03.253650 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:03.253699 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:03.253716 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:03.253845 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:03.254150 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 02:38:03.254234 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:38:03.256132 15780 tablet_replica.cc:330] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c: stopping tablet replica
I20260808 02:38:03.256618 15461 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:03.259205 15781 ts_tablet_manager.cc:1905] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:03.260099 15779 ts_tablet_manager.cc:1918] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:03.260315 15779 log.cc:1196] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/2b179393924a4e75a727a498b652fa68
I20260808 02:38:03.260972 15779 ts_tablet_manager.cc:1939] T 2b179393924a4e75a727a498b652fa68 P 901622db84d44a39967874ec2aea1bd9: Deleting consensus metadata
I20260808 02:38:03.263396 15259 catalog_manager.cc:4841] TS 901622db84d44a39967874ec2aea1bd9 (127.10.20.67:45209): tablet 2b179393924a4e75a727a498b652fa68 (table test-table [id=269fac37966743cebc0dd58d8c2b12cc]) successfully deleted
I20260808 02:38:03.268296 15781 ts_tablet_manager.cc:1918] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:03.268545 15781 log.cc:1196] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/2b179393924a4e75a727a498b652fa68
I20260808 02:38:03.269174 15781 ts_tablet_manager.cc:1939] T 2b179393924a4e75a727a498b652fa68 P 57cbda898e0144ae9b764d0f745f818a: Deleting consensus metadata
I20260808 02:38:03.271953 15261 catalog_manager.cc:4841] TS 57cbda898e0144ae9b764d0f745f818a (127.10.20.66:44655): tablet 2b179393924a4e75a727a498b652fa68 (table test-table [id=269fac37966743cebc0dd58d8c2b12cc]) successfully deleted
I20260808 02:38:03.256767 15780 raft_consensus.cc:2229] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:03.358258 15780 raft_consensus.cc:2258] T 2b179393924a4e75a727a498b652fa68 P a0fcdf5bbaba40fc9753186625135c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:03.358497 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15335
I20260808 02:38:03.389883 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15470
W20260808 02:38:03.389902 15261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:44303 (error 108)
I20260808 02:38:03.392513 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.391902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42100)
0808 02:38:03.392105 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.392275 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 02:38:03.392843 15261 catalog_manager.cc:4584] TS a0fcdf5bbaba40fc9753186625135c5c (127.10.20.65:44303): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b179393924a4e75a727a498b652fa68: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
I20260808 02:38:03.393797 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.391437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49202 (local address 127.10.20.66:44655)
0808 02:38:03.391624 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:03.391628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:03.391669 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:38:03.391740 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:03.391748 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:03.391879 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:03.391988 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:03.393134 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:03.393141 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:03.393145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:03.393164 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:03.393205 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:03.393228 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:03.393376 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:03.393456 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 02:38:03.393522 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:38:03.394470 15594 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:03.447088 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.446440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42110)
0808 02:38:03.446742 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.446875 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 02:38:03.448578 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.448005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42116)
0808 02:38:03.448226 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.448342 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 02:38:03.490852 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15470
I20260808 02:38:03.509368 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.508745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42130)
0808 02:38:03.509059 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.509201 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260808 02:38:03.510639 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.510200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42140)
0808 02:38:03.510403 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.510486 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 02:38:03.518481 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15604
I20260808 02:38:03.522018 15751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.519429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34630 (local address 127.10.20.67:45209)
0808 02:38:03.519666 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:03.519673 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:03.519836 (+ 163us) server_negotiation.cc:407] Connection header received
0808 02:38:03.520034 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:03.520042 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:03.520117 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:03.520253 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:03.521237 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:03.521243 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:03.521247 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:03.521267 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:03.521318 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:03.521339 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:03.521497 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:03.521597 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 02:38:03.521668 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:38:03.523100 15729 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:03.591919 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.591292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42142)
0808 02:38:03.591582 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.591686 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260808 02:38:03.593241 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:03.592780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:44303 (local address 127.0.0.1:42158)
0808 02:38:03.593006 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:03.593091 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:44303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 02:38:03.642726 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15604
I20260808 02:38:03.664948 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15244
I20260808 02:38:03.666324 15305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:03.784085 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15244
2026-08-08T02:38:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3199 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 02:38:03.833920 10321 mini_oidc.cc:152] Starting JWKS server
I20260808 02:38:03.837414 10321 webserver.cc:460] Webserver started at https://127.0.0.1:42389/ using document root <none> and password file <none>
I20260808 02:38:03.837806 10321 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 02:38:03.838631 10321 webserver.cc:460] Webserver started at http://127.0.0.1:40495/ using document root <none> and password file <none>
2026-08-08T02:38:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:03Z Disabled control of system clock
I20260808 02:38:03.882951 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44807
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:34707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:44807
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42389/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/testchainca.cert with env {}
W20260808 02:38:04.249297 15793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:04.249734 15793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:04.249903 15793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:04.257831 15793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:04.258023 15793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:04.258124 15793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:04.258225 15793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:04.258299 15793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:38:04.258389 15793 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:38:04.258461 15793 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42389/jwks.json
I20260808 02:38:04.269966 15793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:44807
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42389/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:04.271493 15793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:04.273157 15793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:04.287297 15798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:04.287256 15799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:04.287345 15801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:04.288483 15793 server_base.cc:1034] running on GCE node
I20260808 02:38:04.289565 15793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:04.291435 15793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:04.292709 15793 hybrid_clock.cc:648] HybridClock initialized: now 1786156684292644 us; error 62 us; skew 500 ppm
I20260808 02:38:04.293174 15793 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:04.302448 15793 webserver.cc:460] Webserver started at http://127.10.20.126:43059/ using document root <none> and password file <none>
I20260808 02:38:04.303347 15793 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:04.303490 15793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:04.303866 15793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:04.307967 15793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "2738c8d9b48f4e8ba7fe8b6008315320"
format_stamp: "Formatted at 2026-08-08 02:38:04 on dist-test-slave-8tdl"
server_key: "95aa6b92209f87dcde06f608a20ede6e"
server_key_iv: "59c0eef4ca3df500add419130121e7d4"
server_key_version: "encryptionkey@0"
I20260808 02:38:04.309116 15793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "2738c8d9b48f4e8ba7fe8b6008315320"
format_stamp: "Formatted at 2026-08-08 02:38:04 on dist-test-slave-8tdl"
server_key: "95aa6b92209f87dcde06f608a20ede6e"
server_key_iv: "59c0eef4ca3df500add419130121e7d4"
server_key_version: "encryptionkey@0"
I20260808 02:38:04.315840 15793 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 02:38:04.320113 15807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:04.321969 15793 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:38:04.322206 15793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "2738c8d9b48f4e8ba7fe8b6008315320"
format_stamp: "Formatted at 2026-08-08 02:38:04 on dist-test-slave-8tdl"
server_key: "95aa6b92209f87dcde06f608a20ede6e"
server_key_iv: "59c0eef4ca3df500add419130121e7d4"
server_key_version: "encryptionkey@0"
I20260808 02:38:04.322505 15793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:04.346278 15793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:04.347366 15793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:04.347692 15793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:04.370843 15793 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:44807
I20260808 02:38:04.370880 15859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:44807 every 8 connection(s)
I20260808 02:38:04.372447 15793 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:04.373929 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15793
I20260808 02:38:04.374192 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:04.375036 10321 external_mini_cluster.cc:1428] Setting key bf8041b80ab5adf6f42cdc228824f444
I20260808 02:38:04.377771 15860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:04.389855 15860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320: Bootstrap starting.
I20260808 02:38:04.390064 15863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:04.377065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32796 (local address 127.10.20.126:44807)
0808 02:38:04.378280 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:04.378298 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:04.378409 (+ 111us) server_negotiation.cc:407] Connection header received
0808 02:38:04.380347 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:04.380370 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:04.380896 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:04.381357 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:04.381975 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:04.383483 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:04.384939 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:04.385639 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:04.385848 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:04.387161 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:04.387169 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:04.387185 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:04.387811 (+ 626us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:04.387905 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:04.387935 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:04.388069 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:04.388298 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 02:38:04.388883 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":390,"threads_started":1}
I20260808 02:38:04.393491 15860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:04.394400 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:38:04.394857 15860 log.cc:824] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:04.398092 15860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320: No bootstrap required, opened a new log
I20260808 02:38:04.406361 15860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44807 } }
I20260808 02:38:04.406909 15860 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:04.407040 15860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2738c8d9b48f4e8ba7fe8b6008315320, State: Initialized, Role: FOLLOWER
I20260808 02:38:04.407805 15860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44807 } }
I20260808 02:38:04.408107 15860 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:04.408262 15860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:04.408445 15860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:04.410861 15860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44807 } }
I20260808 02:38:04.411545 15860 leader_election.cc:302] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2738c8d9b48f4e8ba7fe8b6008315320; no voters:
I20260808 02:38:04.412225 15860 leader_election.cc:288] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:04.412442 15865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:04.413197 15865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [term 1 LEADER]: Becoming Leader. State: Replica: 2738c8d9b48f4e8ba7fe8b6008315320, State: Running, Role: LEADER
I20260808 02:38:04.413793 15865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44807 } }
I20260808 02:38:04.414520 15860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:04.416874 15866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44807 } } }
I20260808 02:38:04.417424 15866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:04.416957 15867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2738c8d9b48f4e8ba7fe8b6008315320. Latest consensus state: current_term: 1 leader_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2738c8d9b48f4e8ba7fe8b6008315320" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44807 } } }
I20260808 02:38:04.419068 15867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:04.421537 15874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:04.427349 15874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:04.439724 15874 catalog_manager.cc:1347] Generated new cluster ID: 319f9629805e4304923822597c263942
I20260808 02:38:04.439889 15874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:04.449790 15874 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:04.451462 15874 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:04.464191 15874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2738c8d9b48f4e8ba7fe8b6008315320: Generated new TSK 0
I20260808 02:38:04.465190 15874 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 02:38:04.506385 15892 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 02:38:04.506654 15892 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 02:38:04.507808 15863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:04.484638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32810 (local address 127.10.20.126:44807)
0808 02:38:04.484934 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:04.484942 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:04.485494 (+ 552us) server_negotiation.cc:407] Connection header received
0808 02:38:04.485989 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:04.485994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:04.486087 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:04.486238 (+ 151us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:38:04.486993 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:04.487780 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:04.489973 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:04.490465 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:04.490596 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:04.491347 (+ 751us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:38:04.507158 (+ 15811us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 02:38:04.507552 (+ 394us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32810: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":86}
W20260808 02:38:04.507982 15863 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32810: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 02:38:04.510315 15891 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:04.484485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44807 (local address 127.0.0.1:32810)
0808 02:38:04.485333 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:04.485358 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:04.485605 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:04.486305 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:04.486310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:04.486326 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:38:04.486826 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:04.486840 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:04.487941 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:04.487948 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:04.489802 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:04.489818 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:04.490735 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:04.490743 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:04.490951 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:04.491046 (+ 95us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:38:04.507553 (+ 16507us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 02:38:04.507990 (+ 437us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.20.126:44807: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":419,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.20.126:44807: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 02:38:04.512216 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15793
I20260808 02:38:04.513659 15855 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:04.617259 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15793
2026-08-08T02:38:04Z chronyd exiting
I20260808 02:38:04.674156 10321 test_util.cc:175] -----------------------------------------------
I20260808 02:38:04.674350 10321 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786156633487900-10321-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (846 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 02:38:04.681620 10321 mini_oidc.cc:152] Starting JWKS server
I20260808 02:38:04.683807 10321 webserver.cc:460] Webserver started at https://127.0.0.1:42643/ using document root <none> and password file <none>
I20260808 02:38:04.684087 10321 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 02:38:04.684934 10321 webserver.cc:460] Webserver started at http://127.0.0.1:43545/ using document root <none> and password file <none>
2026-08-08T02:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:04Z Disabled control of system clock
I20260808 02:38:04.729310 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:40497
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:40497
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42643/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/testchainca.cert with env {}
W20260808 02:38:05.136055 15899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:05.136490 15899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:05.136687 15899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:05.145893 15899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:05.146127 15899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:05.146241 15899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:05.146366 15899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:05.146467 15899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:38:05.146562 15899 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:38:05.146643 15899 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42643/jwks.json
I20260808 02:38:05.158339 15899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:40497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:40497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42643/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:05.159950 15899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:05.161386 15899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:05.175946 15904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:05.176337 15905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:05.176602 15907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:05.177943 15899 server_base.cc:1034] running on GCE node
I20260808 02:38:05.179168 15899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:05.181630 15899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:05.183238 15899 hybrid_clock.cc:648] HybridClock initialized: now 1786156685183154 us; error 77 us; skew 500 ppm
I20260808 02:38:05.183849 15899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:05.188390 15899 webserver.cc:460] Webserver started at http://127.10.20.126:41817/ using document root <none> and password file <none>
I20260808 02:38:05.189575 15899 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:05.189968 15899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:05.190510 15899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:05.194509 15899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "fa488500dee541fa8e2e67cdb1df0af3"
format_stamp: "Formatted at 2026-08-08 02:38:05 on dist-test-slave-8tdl"
server_key: "283bdc0378867f6341fd086fc58d1d50"
server_key_iv: "cf33288c9c5044ceb4b2be80b7f1e6d0"
server_key_version: "encryptionkey@0"
I20260808 02:38:05.196079 15899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "fa488500dee541fa8e2e67cdb1df0af3"
format_stamp: "Formatted at 2026-08-08 02:38:05 on dist-test-slave-8tdl"
server_key: "283bdc0378867f6341fd086fc58d1d50"
server_key_iv: "cf33288c9c5044ceb4b2be80b7f1e6d0"
server_key_version: "encryptionkey@0"
I20260808 02:38:05.203030 15899 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 02:38:05.208101 15913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:05.210326 15899 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260808 02:38:05.210650 15899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "fa488500dee541fa8e2e67cdb1df0af3"
format_stamp: "Formatted at 2026-08-08 02:38:05 on dist-test-slave-8tdl"
server_key: "283bdc0378867f6341fd086fc58d1d50"
server_key_iv: "cf33288c9c5044ceb4b2be80b7f1e6d0"
server_key_version: "encryptionkey@0"
I20260808 02:38:05.211022 15899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:05.232846 15899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:05.234280 15899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:05.234889 15899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:05.261204 15899 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:40497
I20260808 02:38:05.261217 15964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:40497 every 8 connection(s)
I20260808 02:38:05.263681 15899 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:05.268097 15965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:05.272758 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 15899
I20260808 02:38:05.273182 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:05.273998 10321 external_mini_cluster.cc:1428] Setting key 0211f62952ac55496bd72245efa7377a
I20260808 02:38:05.282009 15965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3: Bootstrap starting.
I20260808 02:38:05.286194 15965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:05.287758 15965 log.cc:824] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:05.291973 15965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3: No bootstrap required, opened a new log
I20260808 02:38:05.292064 15968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:05.277098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.10.20.126:40497)
0808 02:38:05.278324 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:05.278337 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:05.278392 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:38:05.280523 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:05.280552 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:05.281143 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:05.281548 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:05.282357 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:05.283932 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:05.286039 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:05.286999 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:05.287159 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:05.288754 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:05.288770 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:05.288798 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:05.289683 (+ 885us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:05.289780 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:05.289806 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:05.289911 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:05.290416 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 02:38:05.290920 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":457,"threads_started":1}
I20260808 02:38:05.297356 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:38:05.301716 15965 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa488500dee541fa8e2e67cdb1df0af3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40497 } }
I20260808 02:38:05.302227 15965 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:05.302350 15965 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa488500dee541fa8e2e67cdb1df0af3, State: Initialized, Role: FOLLOWER
I20260808 02:38:05.303063 15965 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa488500dee541fa8e2e67cdb1df0af3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40497 } }
I20260808 02:38:05.303344 15965 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:05.303508 15965 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:05.303702 15965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:05.306236 15965 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa488500dee541fa8e2e67cdb1df0af3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40497 } }
I20260808 02:38:05.306991 15965 leader_election.cc:302] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa488500dee541fa8e2e67cdb1df0af3; no voters:
I20260808 02:38:05.307693 15965 leader_election.cc:288] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:05.307945 15970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:05.308831 15970 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [term 1 LEADER]: Becoming Leader. State: Replica: fa488500dee541fa8e2e67cdb1df0af3, State: Running, Role: LEADER
I20260808 02:38:05.309479 15970 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa488500dee541fa8e2e67cdb1df0af3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40497 } }
I20260808 02:38:05.311029 15965 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:05.314828 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa488500dee541fa8e2e67cdb1df0af3. Latest consensus state: current_term: 1 leader_uuid: "fa488500dee541fa8e2e67cdb1df0af3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa488500dee541fa8e2e67cdb1df0af3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40497 } } }
I20260808 02:38:05.315445 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:05.315977 15971 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa488500dee541fa8e2e67cdb1df0af3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa488500dee541fa8e2e67cdb1df0af3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40497 } } }
I20260808 02:38:05.316562 15971 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:05.319660 15979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:05.325672 15979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:05.338184 15979 catalog_manager.cc:1347] Generated new cluster ID: 8a51a1266c994ce9b72b4631aa32cf7d
I20260808 02:38:05.338382 15979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:05.377925 15979 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:05.379623 15979 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:05.388078 15979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa488500dee541fa8e2e67cdb1df0af3: Generated new TSK 0
I20260808 02:38:05.389101 15979 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 02:38:05.431217 15995 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 02:38:05.431384 15995 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 02:38:05.432750 15968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:05.410400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.10.20.126:40497)
0808 02:38:05.410643 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:05.410649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:05.411104 (+ 455us) server_negotiation.cc:407] Connection header received
0808 02:38:05.411458 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:05.411463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:05.411554 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:05.411724 (+ 170us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:38:05.412401 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:05.413353 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:05.415696 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:05.416256 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:05.416444 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:05.417181 (+ 737us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:38:05.431964 (+ 14783us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 02:38:05.432425 (+ 461us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42466: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":101}
W20260808 02:38:05.432910 15968 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42466: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 02:38:05.433020 15994 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:05.410193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:40497 (local address 127.0.0.1:42466)
0808 02:38:05.410911 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:05.410933 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:05.411119 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:05.411751 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:05.411757 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:05.411773 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:38:05.412120 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:05.412135 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:05.413539 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:05.413546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:05.415440 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:05.415461 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:05.416575 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:05.416586 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:05.416807 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:05.416850 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:38:05.432260 (+ 15410us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 02:38:05.432565 (+ 305us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.20.126:40497: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42643/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":338,"threads_started":1}
I20260808 02:38:05.435389 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 15899
I20260808 02:38:05.436960 15960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:05.542179 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 15899
2026-08-08T02:38:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (924 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 02:38:05.603433 10321 mini_oidc.cc:152] Starting JWKS server
I20260808 02:38:05.605816 10321 webserver.cc:460] Webserver started at https://127.0.0.1:46323/ using document root <none> and password file <none>
I20260808 02:38:05.606137 10321 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 02:38:05.607101 10321 webserver.cc:460] Webserver started at http://127.0.0.1:34305/ using document root <none> and password file <none>
2026-08-08T02:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:05Z Disabled control of system clock
I20260808 02:38:05.650506 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:40331
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:40803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:40331
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46323/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 02:38:06.021603 16002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:06.022017 16002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:06.022189 16002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:06.030159 16002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:06.030337 16002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:06.030431 16002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:06.030552 16002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:06.030632 16002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:38:06.030746 16002 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:38:06.030812 16002 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46323/jwks.json
I20260808 02:38:06.040869 16002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:40803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:40331
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:40331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46323/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:06.042347 16002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:06.044306 16002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:06.057623 16012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:06.057685 16008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:06.057662 16007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:06.058782 16002 server_base.cc:1034] running on GCE node
I20260808 02:38:06.059697 16002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:06.061431 16002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:06.062752 16002 hybrid_clock.cc:648] HybridClock initialized: now 1786156686062639 us; error 54 us; skew 500 ppm
I20260808 02:38:06.063169 16002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:06.065701 16002 webserver.cc:460] Webserver started at http://127.10.20.126:44235/ using document root <none> and password file <none>
I20260808 02:38:06.066471 16002 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:06.066622 16002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:06.067014 16002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:06.070211 16002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "ee247f9fe5904ed3a761c19c2d56ae04"
format_stamp: "Formatted at 2026-08-08 02:38:06 on dist-test-slave-8tdl"
server_key: "a7eb0a8d36f63651809d326eb6adaca2"
server_key_iv: "64681c0f713e0f4973d54363f8bfbae4"
server_key_version: "encryptionkey@0"
I20260808 02:38:06.071182 16002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "ee247f9fe5904ed3a761c19c2d56ae04"
format_stamp: "Formatted at 2026-08-08 02:38:06 on dist-test-slave-8tdl"
server_key: "a7eb0a8d36f63651809d326eb6adaca2"
server_key_iv: "64681c0f713e0f4973d54363f8bfbae4"
server_key_version: "encryptionkey@0"
I20260808 02:38:06.077288 16002 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:38:06.081543 16018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:06.083371 16002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:38:06.083612 16002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "ee247f9fe5904ed3a761c19c2d56ae04"
format_stamp: "Formatted at 2026-08-08 02:38:06 on dist-test-slave-8tdl"
server_key: "a7eb0a8d36f63651809d326eb6adaca2"
server_key_iv: "64681c0f713e0f4973d54363f8bfbae4"
server_key_version: "encryptionkey@0"
I20260808 02:38:06.083889 16002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:06.126116 16002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:06.127229 16002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:06.127589 16002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:06.149000 16002 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:40331
I20260808 02:38:06.149039 16070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:40331 every 8 connection(s)
I20260808 02:38:06.150462 16002 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:06.151364 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16002
I20260808 02:38:06.151640 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:06.152433 10321 external_mini_cluster.cc:1428] Setting key 8dc120a71cdc1c7baab718449c878688
I20260808 02:38:06.155915 16071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:06.170257 16074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:06.154395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51666 (local address 127.10.20.126:40331)
0808 02:38:06.156027 (+ 1632us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:06.156044 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:06.156098 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:38:06.158566 (+ 2468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:06.158598 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:06.159295 (+ 697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:06.159813 (+ 518us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:06.160435 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.162556 (+ 2121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.164208 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.165317 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.165532 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:06.166897 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:06.166913 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:06.166943 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:06.167846 (+ 903us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:06.167968 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:06.168006 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:06.168142 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:06.168437 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 02:38:06.168838 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1077,"thread_start_us":810,"threads_started":1}
I20260808 02:38:06.171569 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04: Bootstrap starting.
I20260808 02:38:06.175110 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:38:06.175280 16071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:06.176656 16071 log.cc:824] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:06.180523 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04: No bootstrap required, opened a new log
I20260808 02:38:06.189968 16071 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40331 } }
I20260808 02:38:06.190428 16071 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:06.190502 16071 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee247f9fe5904ed3a761c19c2d56ae04, State: Initialized, Role: FOLLOWER
I20260808 02:38:06.191217 16071 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40331 } }
I20260808 02:38:06.191464 16071 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:06.191576 16071 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:06.191709 16071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:06.194355 16071 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40331 } }
I20260808 02:38:06.194985 16071 leader_election.cc:302] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee247f9fe5904ed3a761c19c2d56ae04; no voters:
I20260808 02:38:06.195640 16071 leader_election.cc:288] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:06.195888 16076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:06.196784 16076 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [term 1 LEADER]: Becoming Leader. State: Replica: ee247f9fe5904ed3a761c19c2d56ae04, State: Running, Role: LEADER
I20260808 02:38:06.197382 16076 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40331 } }
I20260808 02:38:06.198043 16071 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:06.200307 16078 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee247f9fe5904ed3a761c19c2d56ae04. Latest consensus state: current_term: 1 leader_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40331 } } }
I20260808 02:38:06.200759 16078 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:06.200807 16077 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee247f9fe5904ed3a761c19c2d56ae04" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 40331 } } }
I20260808 02:38:06.201134 16077 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:06.203368 16081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:06.209621 16081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:06.220734 16081 catalog_manager.cc:1347] Generated new cluster ID: d0e7b94e315d4d7a8931b203b5b7bf5c
I20260808 02:38:06.220973 16081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:06.235481 16081 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:06.237470 16081 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:06.249377 16081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee247f9fe5904ed3a761c19c2d56ae04: Generated new TSK 0
I20260808 02:38:06.250715 16081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:38:06.277869 16074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:06.269223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51670 (local address 127.10.20.126:40331)
0808 02:38:06.269459 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:06.269468 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:06.269746 (+ 278us) server_negotiation.cc:407] Connection header received
0808 02:38:06.270069 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:06.270073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:06.270151 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:06.270335 (+ 184us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:38:06.270927 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.271712 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.273208 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.273707 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.273868 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:06.274489 (+ 621us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:38:06.277150 (+ 2661us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 02:38:06.277545 (+ 395us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51670: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 02:38:06.278026 16074 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51670: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 02:38:06.280268 16100 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:06.269066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:40331 (local address 127.0.0.1:51670)
0808 02:38:06.269637 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:06.269659 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:06.269833 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:06.270350 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:06.270355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:06.270367 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:38:06.270748 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:06.270760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.271881 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.271887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:06.273033 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:06.273046 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.273938 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.273949 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:06.274114 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:06.274154 (+ 40us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:38:06.277458 (+ 3304us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 02:38:06.279766 (+ 2308us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.20.126:40331: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46323/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":1877,"thread_start_us":427,"threads_started":1}
I20260808 02:38:06.281576 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16002
I20260808 02:38:06.283053 16066 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 02:38:06.290230 16101 webserver.cc:533] Webserver: sslize failed:
E20260808 02:38:06.290392 16101 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 02:38:06.382846 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16002
2026-08-08T02:38:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (840 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T02:38:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:06Z Disabled control of system clock
I20260808 02:38:06.488724 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35709
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:35709
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/testchainca.cert with env {}
W20260808 02:38:06.868271 16106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:06.868755 16106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:06.868909 16106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:06.877677 16106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:06.877836 16106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:06.877877 16106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:06.877996 16106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:06.878072 16106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 02:38:06.878190 16106 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 02:38:06.878248 16106 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 02:38:06.889110 16106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:35709
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:06.890635 16106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:06.892163 16106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:06.906311 16114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:06.906275 16111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:06.906349 16112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:06.907588 16106 server_base.cc:1034] running on GCE node
I20260808 02:38:06.908627 16106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:06.910357 16106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:06.911635 16106 hybrid_clock.cc:648] HybridClock initialized: now 1786156686911558 us; error 76 us; skew 500 ppm
I20260808 02:38:06.912081 16106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:38:06.915155 16106 webserver.cc:460] Webserver started at http://127.10.20.126:33263/ using document root <none> and password file <none>
I20260808 02:38:06.915902 16106 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:06.916007 16106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:06.916307 16106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:06.919627 16106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "ab972e3a8f064bdfbfee0d61892529b3"
format_stamp: "Formatted at 2026-08-08 02:38:06 on dist-test-slave-8tdl"
server_key: "7322a41ce3c3ff7e255e6b8c43f2139a"
server_key_iv: "85c88fedf0510b320f647f571f1f5471"
server_key_version: "encryptionkey@0"
I20260808 02:38:06.920557 16106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "ab972e3a8f064bdfbfee0d61892529b3"
format_stamp: "Formatted at 2026-08-08 02:38:06 on dist-test-slave-8tdl"
server_key: "7322a41ce3c3ff7e255e6b8c43f2139a"
server_key_iv: "85c88fedf0510b320f647f571f1f5471"
server_key_version: "encryptionkey@0"
I20260808 02:38:06.926990 16106 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:38:06.931185 16120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:06.932917 16106 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:38:06.933108 16106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "ab972e3a8f064bdfbfee0d61892529b3"
format_stamp: "Formatted at 2026-08-08 02:38:06 on dist-test-slave-8tdl"
server_key: "7322a41ce3c3ff7e255e6b8c43f2139a"
server_key_iv: "85c88fedf0510b320f647f571f1f5471"
server_key_version: "encryptionkey@0"
I20260808 02:38:06.933333 16106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:06.955051 16106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:06.956036 16106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:06.956317 16106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:06.978297 16106 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:35709
I20260808 02:38:06.978345 16173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:35709 every 8 connection(s)
I20260808 02:38:06.979848 16106 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:06.980788 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16106
I20260808 02:38:06.981025 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:06.981894 10321 external_mini_cluster.cc:1428] Setting key 59088e36c9e9d5540f7441a669d839b0
I20260808 02:38:06.985356 16174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:06.999264 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:06.984184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38936 (local address 127.10.20.126:35709)
0808 02:38:06.985556 (+ 1372us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:06.985580 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:06.985629 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:38:06.987570 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:06.987598 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:06.988376 (+ 778us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:06.988800 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:06.989605 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.991375 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.993421 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:06.994264 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:06.994443 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:06.996321 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:06.996331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:06.996353 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:38:06.997041 (+ 688us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:06.997132 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:38:06.997161 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:06.997276 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:06.997611 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 02:38:06.998093 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":867,"thread_start_us":634,"threads_started":1}
I20260808 02:38:07.000360 16174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3: Bootstrap starting.
I20260808 02:38:07.004626 16174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:07.004976 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:38:07.005843 16174 log.cc:824] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:07.009698 16174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3: No bootstrap required, opened a new log
I20260808 02:38:07.018018 16174 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab972e3a8f064bdfbfee0d61892529b3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35709 } }
I20260808 02:38:07.018579 16174 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:07.018755 16174 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab972e3a8f064bdfbfee0d61892529b3, State: Initialized, Role: FOLLOWER
I20260808 02:38:07.019506 16174 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab972e3a8f064bdfbfee0d61892529b3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35709 } }
I20260808 02:38:07.019788 16174 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:07.019961 16174 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:07.020151 16174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:07.022579 16174 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab972e3a8f064bdfbfee0d61892529b3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35709 } }
I20260808 02:38:07.023234 16174 leader_election.cc:302] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab972e3a8f064bdfbfee0d61892529b3; no voters:
I20260808 02:38:07.024017 16174 leader_election.cc:288] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:07.024266 16179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:07.025418 16179 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [term 1 LEADER]: Becoming Leader. State: Replica: ab972e3a8f064bdfbfee0d61892529b3, State: Running, Role: LEADER
I20260808 02:38:07.025974 16179 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab972e3a8f064bdfbfee0d61892529b3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35709 } }
I20260808 02:38:07.026495 16174 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:07.029568 16181 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab972e3a8f064bdfbfee0d61892529b3. Latest consensus state: current_term: 1 leader_uuid: "ab972e3a8f064bdfbfee0d61892529b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab972e3a8f064bdfbfee0d61892529b3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35709 } } }
I20260808 02:38:07.029594 16180 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab972e3a8f064bdfbfee0d61892529b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab972e3a8f064bdfbfee0d61892529b3" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35709 } } }
I20260808 02:38:07.030055 16181 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:07.030114 16180 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:07.032564 16187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:07.037853 16187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:07.048087 16187 catalog_manager.cc:1347] Generated new cluster ID: 38946eed55c841c7b265f2569b39345f
I20260808 02:38:07.048274 16187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:07.065378 16187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:07.067481 16187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:07.087904 16187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab972e3a8f064bdfbfee0d61892529b3: Generated new TSK 0
I20260808 02:38:07.089126 16187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:38:08.923512 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:07.112842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.10.20.126:35709)
0808 02:38:07.113061 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:07.113068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:07.113361 (+ 293us) server_negotiation.cc:407] Connection header received
0808 02:38:07.113625 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:07.113631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:07.113745 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:07.113946 (+ 201us) server_negotiation.cc:226] Negotiated authn=JWT
0808 02:38:07.114539 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:07.115764 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:07.117221 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:07.117946 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:07.118086 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:07.118753 (+ 667us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 02:38:08.922875 (+1804122us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 02:38:08.923262 (+ 387us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38952: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":90}
W20260808 02:38:08.923620 16177 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38952: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 02:38:08.924130 16203 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:07.112607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35709 (local address 127.0.0.1:38952)
0808 02:38:07.113245 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:07.113263 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:07.113405 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:07.114064 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:07.114068 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:07.114079 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0808 02:38:07.114349 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:07.114358 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:07.115933 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:07.115938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:07.117059 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:07.117072 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:07.118190 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:07.118195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:07.118333 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:07.118372 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 02:38:08.923286 (+1804914us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 02:38:08.923724 (+ 438us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.20.126:35709: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":344,"threads_started":1}
I20260808 02:38:08.926051 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16106
I20260808 02:38:08.927488 16169 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:09.042085 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16106
2026-08-08T02:38:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (2640 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (477 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (492 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:38:10 dist-test-slave-8tdl krb5kdc[16218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:38:10 dist-test-slave-8tdl krb5kdc[16218](info): set up 2 sockets
Aug 08 02:38:10 dist-test-slave-8tdl krb5kdc[16218](info): commencing operation
krb5kdc: starting...
W20260808 02:38:11.223313 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:38:11 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:38:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:38:11.540150 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42621
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:42621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:11.923471 16231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:11.923833 16231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:11.924006 16231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:11.931927 16231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:11.932089 16231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:11.932183 16231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:11.932281 16231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:11.932377 16231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:11.943243 16231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:42621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:11.944818 16231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:11.946324 16231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:11.965903 16236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:11.965975 16239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:11.965909 16237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:11.967617 16231 server_base.cc:1034] running on GCE node
I20260808 02:38:11.969297 16231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:11.972620 16231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:11.974128 16231 hybrid_clock.cc:648] HybridClock initialized: now 1786156691974008 us; error 115 us; skew 500 ppm
I20260808 02:38:11.974885 16231 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:11 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156691, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:11.980413 16231 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:38:11.984146 16231 webserver.cc:460] Webserver started at http://127.10.20.126:32829/ using document root <none> and password file <none>
I20260808 02:38:11.985778 16231 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:11.986151 16231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:11.987012 16231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:11.993855 16231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "9457d639869046cdb52ce571b0910d48"
format_stamp: "Formatted at 2026-08-08 02:38:11 on dist-test-slave-8tdl"
server_key: "6c99a515892bd90f50a9325d8e89f338"
server_key_iv: "2c52dc39d2ff14185720c376ba73fed1"
server_key_version: "encryptionkey@0"
I20260808 02:38:11.996114 16231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "9457d639869046cdb52ce571b0910d48"
format_stamp: "Formatted at 2026-08-08 02:38:11 on dist-test-slave-8tdl"
server_key: "6c99a515892bd90f50a9325d8e89f338"
server_key_iv: "2c52dc39d2ff14185720c376ba73fed1"
server_key_version: "encryptionkey@0"
I20260808 02:38:12.007282 16231 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.011s sys 0.000s
I20260808 02:38:12.014474 16246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:12.017442 16231 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260808 02:38:12.017879 16231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "9457d639869046cdb52ce571b0910d48"
format_stamp: "Formatted at 2026-08-08 02:38:11 on dist-test-slave-8tdl"
server_key: "6c99a515892bd90f50a9325d8e89f338"
server_key_iv: "2c52dc39d2ff14185720c376ba73fed1"
server_key_version: "encryptionkey@0"
I20260808 02:38:12.018396 16231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:12.042104 16231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:12.051254 16231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:12.051858 16231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:12.088557 16231 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:42621
I20260808 02:38:12.088593 16298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:42621 every 8 connection(s)
I20260808 02:38:12.090850 16231 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:12.097239 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16231
I20260808 02:38:12.097539 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:12.099452 10321 external_mini_cluster.cc:1428] Setting key 46b38f3fa301f3257a831877a4a3d912
I20260808 02:38:12.099421 16299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:12.123462 16299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48: Bootstrap starting.
Aug 08 02:38:12 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:12.130559 16299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:12.133496 16299 log.cc:824] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:12.140153 16299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48: No bootstrap required, opened a new log
I20260808 02:38:12.145885 16302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:12.103607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37816 (local address 127.10.20.126:42621)
0808 02:38:12.105202 (+ 1595us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:12.105238 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:12.105355 (+ 117us) server_negotiation.cc:407] Connection header received
0808 02:38:12.108684 (+ 3329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:12.108737 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:12.109611 (+ 874us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:12.110519 (+ 908us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:12.113577 (+ 3058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:12.116229 (+ 2652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:12.118784 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:12.120193 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:12.120670 (+ 477us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:12.128112 (+ 7442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:12.128126 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:12.128148 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:12.128238 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:12.135301 (+ 7063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:12.136651 (+ 1350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:12.136675 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:12.136706 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:12.137195 (+ 489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:12.138115 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:12.138134 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:12.138138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:12.139839 (+ 1701us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:12.140223 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:12.141375 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0808 02:38:12.142458 (+ 1083us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1204,"thread_start_us":700,"threads_started":1}
I20260808 02:38:12.157996 16299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9457d639869046cdb52ce571b0910d48" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42621 } }
I20260808 02:38:12.158720 16299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:12.158893 16299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9457d639869046cdb52ce571b0910d48, State: Initialized, Role: FOLLOWER
I20260808 02:38:12.159917 16299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9457d639869046cdb52ce571b0910d48" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42621 } }
I20260808 02:38:12.160348 16299 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:12.160511 16299 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:12.160748 16299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:12.165362 16299 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9457d639869046cdb52ce571b0910d48" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42621 } }
I20260808 02:38:12.166643 16299 leader_election.cc:302] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9457d639869046cdb52ce571b0910d48; no voters:
I20260808 02:38:12.168057 16299 leader_election.cc:288] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:12.168383 16304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:12.171087 16304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [term 1 LEADER]: Becoming Leader. State: Replica: 9457d639869046cdb52ce571b0910d48, State: Running, Role: LEADER
I20260808 02:38:12.172164 16304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9457d639869046cdb52ce571b0910d48" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42621 } }
I20260808 02:38:12.172602 16299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:12.178097 16306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9457d639869046cdb52ce571b0910d48. Latest consensus state: current_term: 1 leader_uuid: "9457d639869046cdb52ce571b0910d48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9457d639869046cdb52ce571b0910d48" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42621 } } }
I20260808 02:38:12.178170 16305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9457d639869046cdb52ce571b0910d48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9457d639869046cdb52ce571b0910d48" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42621 } } }
I20260808 02:38:12.179764 16305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:12.180495 16306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:12.185038 16313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:12.196038 16313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:12.213682 16313 catalog_manager.cc:1347] Generated new cluster ID: 7ce5765ef73747dbbc3dea9f1398e606
I20260808 02:38:12.214025 16313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:12.236893 16313 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:12.239940 16313 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:12.252933 16313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9457d639869046cdb52ce571b0910d48: Generated new TSK 0
I20260808 02:38:12.255127 16313 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
W20260808 02:38:12.372637 10321 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.20.65: real 0.109s user 0.000s sys 0.036s
I20260808 02:38:12.374570 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42621
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:12.998662 16325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:12.999075 16325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:12.999243 16325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:13.007004 16325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:13.007146 16325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:13.007342 16325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:13.017915 16325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:13.019534 16325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:13.021001 16325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:13.036777 16330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:13.036846 16333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:13.036728 16331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:13.037186 16325 server_base.cc:1034] running on GCE node
I20260808 02:38:13.038368 16325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:13.039660 16325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:13.040940 16325 hybrid_clock.cc:648] HybridClock initialized: now 1786156693040858 us; error 85 us; skew 500 ppm
I20260808 02:38:13.041561 16325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:13 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156693, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:13.045485 16325 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:38:13.047340 16325 webserver.cc:460] Webserver started at http://127.10.20.65:33687/ using document root <none> and password file <none>
I20260808 02:38:13.048467 16325 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:13.048712 16325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:13.049185 16325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:13.052718 16325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "5bd8878cce264939aba474b57f0376a0"
format_stamp: "Formatted at 2026-08-08 02:38:13 on dist-test-slave-8tdl"
server_key: "f662a56d4015e3d5667a1ca89c8c0d5c"
server_key_iv: "c0b6e34451ef0f145b4c46cc7355c15a"
server_key_version: "encryptionkey@0"
I20260808 02:38:13.053663 16325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "5bd8878cce264939aba474b57f0376a0"
format_stamp: "Formatted at 2026-08-08 02:38:13 on dist-test-slave-8tdl"
server_key: "f662a56d4015e3d5667a1ca89c8c0d5c"
server_key_iv: "c0b6e34451ef0f145b4c46cc7355c15a"
server_key_version: "encryptionkey@0"
I20260808 02:38:13.059923 16325 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:38:13.064185 16340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:13.065876 16325 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:38:13.066215 16325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "5bd8878cce264939aba474b57f0376a0"
format_stamp: "Formatted at 2026-08-08 02:38:13 on dist-test-slave-8tdl"
server_key: "f662a56d4015e3d5667a1ca89c8c0d5c"
server_key_iv: "c0b6e34451ef0f145b4c46cc7355c15a"
server_key_version: "encryptionkey@0"
I20260808 02:38:13.066530 16325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:13.087819 16325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:13.093308 16325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:13.093660 16325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:13.094874 16325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:13.096472 16325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:13.096594 16325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:13.096764 16325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:13.096839 16325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:13.138638 16325 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:39653
I20260808 02:38:13.138716 16459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:39653 every 8 connection(s)
I20260808 02:38:13.140221 16325 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:13.146384 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16325
I20260808 02:38:13.146636 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:38:13.147534 10321 external_mini_cluster.cc:1428] Setting key dc488f476a3fc9ff4c503682b6a62776
Aug 08 02:38:13 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156693, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:13.168426 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:13.143261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:55795 (local address 127.10.20.126:42621)
0808 02:38:13.143832 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:13.143839 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:13.144806 (+ 967us) server_negotiation.cc:407] Connection header received
0808 02:38:13.147503 (+ 2697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:13.147508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:13.147590 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:13.147773 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:13.150215 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.151131 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.152890 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.153341 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.153509 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:13.158837 (+ 5328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:13.158845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:13.158849 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:13.158957 (+ 108us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:13.164072 (+ 5115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:13.165149 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:13.165156 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:13.165162 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:13.165348 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:13.165920 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:13.165926 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:13.165932 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:13.166286 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:13.166492 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:13.167446 (+ 954us) server_negotiation.cc:299] Negotiation successful
0808 02:38:13.167768 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":299,"threads_started":1}
I20260808 02:38:13.170150 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:13.143781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42621 (local address 127.10.20.65:55795)
0808 02:38:13.144610 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:13.144657 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:13.147074 (+ 2417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:13.148177 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:13.148191 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:13.149040 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:13.149991 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:13.150017 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.151327 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.151333 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:13.152701 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:13.152717 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.153620 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.153631 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:13.153922 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:13.154878 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:13.154911 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:13.158248 (+ 3337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:13.164333 (+ 6085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:13.164343 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:13.164361 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:13.164965 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:13.165526 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:13.165531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:13.165533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:13.165775 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:13.166454 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:13.166465 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:13.166996 (+ 531us) client_negotiation.cc:769] Sending connection context
0808 02:38:13.167340 (+ 344us) client_negotiation.cc:240] Negotiation successful
0808 02:38:13.168216 (+ 876us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":348,"threads_started":1}
I20260808 02:38:13.173182 16460 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42621
I20260808 02:38:13.173918 16460 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:13.174979 16460 heartbeater.cc:511] Master 127.10.20.126:42621 requested a full tablet report, sending...
I20260808 02:38:13.177872 16263 ts_manager.cc:194] Registered new tserver with Master: 5bd8878cce264939aba474b57f0376a0 (127.10.20.65:39653)
I20260808 02:38:13.180430 16263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:55795
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:38:13.224820 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42621
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:13.623610 16466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:13.624009 16466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:13.624130 16466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:13.633386 16466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:13.633544 16466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:13.633668 16466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:13.644605 16466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:13.646039 16466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:13.647542 16466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:13.663694 16471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:13.663838 16474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:13.663717 16472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:13.664628 16466 server_base.cc:1034] running on GCE node
I20260808 02:38:13.665349 16466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:13.666613 16466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:13.667920 16466 hybrid_clock.cc:648] HybridClock initialized: now 1786156693667860 us; error 58 us; skew 500 ppm
I20260808 02:38:13.668386 16466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:13 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156693, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:13.672170 16466 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:38:13.674310 16466 webserver.cc:460] Webserver started at http://127.10.20.66:40183/ using document root <none> and password file <none>
I20260808 02:38:13.675261 16466 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:13.675418 16466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:13.675819 16466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:13.679557 16466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "70f59c65295a4b4497431f34deb7305b"
format_stamp: "Formatted at 2026-08-08 02:38:13 on dist-test-slave-8tdl"
server_key: "2d5584cb05cd0dd94a4eeaf9fa2e3644"
server_key_iv: "9c0e7d2504f018681486aaad986953ee"
server_key_version: "encryptionkey@0"
I20260808 02:38:13.680588 16466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "70f59c65295a4b4497431f34deb7305b"
format_stamp: "Formatted at 2026-08-08 02:38:13 on dist-test-slave-8tdl"
server_key: "2d5584cb05cd0dd94a4eeaf9fa2e3644"
server_key_iv: "9c0e7d2504f018681486aaad986953ee"
server_key_version: "encryptionkey@0"
I20260808 02:38:13.687292 16466 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 02:38:13.691823 16481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:13.693511 16466 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:38:13.693742 16466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "70f59c65295a4b4497431f34deb7305b"
format_stamp: "Formatted at 2026-08-08 02:38:13 on dist-test-slave-8tdl"
server_key: "2d5584cb05cd0dd94a4eeaf9fa2e3644"
server_key_iv: "9c0e7d2504f018681486aaad986953ee"
server_key_version: "encryptionkey@0"
I20260808 02:38:13.693994 16466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:13.733537 16466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:13.738864 16466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:13.739234 16466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:13.740430 16466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:13.742080 16466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:13.742172 16466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:13.742333 16466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:13.742393 16466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:13.781438 16466 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:37449
I20260808 02:38:13.781747 16597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:37449 every 8 connection(s)
I20260808 02:38:13.782953 16466 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:13.789535 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16466
I20260808 02:38:13.789762 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:38:13.790324 10321 external_mini_cluster.cc:1428] Setting key 077faee12fe727f36064c0d3d0041c6e
Aug 08 02:38:13 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156693, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:13.813587 16600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:13.786307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:55737 (local address 127.10.20.126:42621)
0808 02:38:13.787081 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:13.787086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:13.788408 (+ 1322us) server_negotiation.cc:407] Connection header received
0808 02:38:13.791254 (+ 2846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:13.791261 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:13.791370 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:13.791516 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:13.793626 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.794643 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.798968 (+ 4325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.799604 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.799760 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:13.805772 (+ 6012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:13.805778 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:13.805781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:13.805826 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:13.809250 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:13.810718 (+ 1468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:13.810728 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:13.810732 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:13.810913 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:13.811455 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:13.811461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:13.811463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:13.811868 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:13.812069 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:13.812891 (+ 822us) server_negotiation.cc:299] Negotiation successful
0808 02:38:13.813212 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":287,"threads_started":1}
I20260808 02:38:13.814779 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:13.787048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42621 (local address 127.10.20.66:55737)
0808 02:38:13.788205 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:13.788258 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:13.790828 (+ 2570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:13.791822 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:13.791832 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:13.792468 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:13.793344 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:13.793377 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.795002 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.795012 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:13.798562 (+ 3550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:13.798593 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:13.799934 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:13.799946 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:13.800436 (+ 490us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:13.801492 (+ 1056us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:13.801542 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:13.805353 (+ 3811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:13.809523 (+ 4170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:13.809533 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:13.809551 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:13.810463 (+ 912us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:13.811061 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:13.811067 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:13.811071 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:13.811305 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:13.812044 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:13.812053 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:13.812475 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 02:38:13.812782 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 02:38:13.813398 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":387,"threads_started":1}
I20260808 02:38:13.816790 16598 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42621
I20260808 02:38:13.817239 16598 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:13.818138 16598 heartbeater.cc:511] Master 127.10.20.126:42621 requested a full tablet report, sending...
I20260808 02:38:13.820199 16263 ts_manager.cc:194] Registered new tserver with Master: 70f59c65295a4b4497431f34deb7305b (127.10.20.66:37449)
I20260808 02:38:13.821496 16263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:55737
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:38:13.863039 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42621
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:14.184774 16460 heartbeater.cc:503] Master 127.10.20.126:42621 was elected leader, sending a full tablet report...
W20260808 02:38:14.241169 16604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:14.241515 16604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:14.241613 16604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:14.249745 16604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:14.249895 16604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:14.250025 16604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:14.260682 16604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:14.262104 16604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:14.263567 16604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:14.278846 16610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:14.279327 16612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:14.279546 16609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:14.280907 16604 server_base.cc:1034] running on GCE node
I20260808 02:38:14.281809 16604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:14.283100 16604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:14.284332 16604 hybrid_clock.cc:648] HybridClock initialized: now 1786156694284273 us; error 39 us; skew 500 ppm
I20260808 02:38:14.284766 16604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.288698 16604 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:38:14.290630 16604 webserver.cc:460] Webserver started at http://127.10.20.67:37439/ using document root <none> and password file <none>
I20260808 02:38:14.291503 16604 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:14.291674 16604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:14.292045 16604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:14.295562 16604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "fef0187308de431cb5e92e489ac348c8"
format_stamp: "Formatted at 2026-08-08 02:38:14 on dist-test-slave-8tdl"
server_key: "d22e8a56f3560c71a9d02622597867b2"
server_key_iv: "7ebd208b38487ad226e6ee9d083d876d"
server_key_version: "encryptionkey@0"
I20260808 02:38:14.296509 16604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "fef0187308de431cb5e92e489ac348c8"
format_stamp: "Formatted at 2026-08-08 02:38:14 on dist-test-slave-8tdl"
server_key: "d22e8a56f3560c71a9d02622597867b2"
server_key_iv: "7ebd208b38487ad226e6ee9d083d876d"
server_key_version: "encryptionkey@0"
I20260808 02:38:14.303413 16604 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:38:14.308905 16619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:14.311079 16604 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:38:14.311347 16604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "fef0187308de431cb5e92e489ac348c8"
format_stamp: "Formatted at 2026-08-08 02:38:14 on dist-test-slave-8tdl"
server_key: "d22e8a56f3560c71a9d02622597867b2"
server_key_iv: "7ebd208b38487ad226e6ee9d083d876d"
server_key_version: "encryptionkey@0"
I20260808 02:38:14.311666 16604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:14.329066 16604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:14.336267 16604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:14.336709 16604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:14.338063 16604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:14.339844 16604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:14.339972 16604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:14.340168 16604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:14.340260 16604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:14.382311 16604 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:41043
I20260808 02:38:14.382372 16736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:41043 every 8 connection(s)
I20260808 02:38:14.383849 16604 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:14.386994 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16604
I20260808 02:38:14.387247 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:38:14.387984 10321 external_mini_cluster.cc:1428] Setting key f804a07cd97c265b83fa0c0873524d98
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:14.409845 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.387140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:52721 (local address 127.10.20.126:42621)
0808 02:38:14.389884 (+ 2744us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.389892 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.389912 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:38:14.391601 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.391606 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.391704 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.391854 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.393676 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.394565 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.396496 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.397032 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.397158 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.402002 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.402009 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.402013 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.402058 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.405925 (+ 3867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.407021 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.407025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.407028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.407194 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.407823 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.407827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.407829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.408211 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.408348 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.409315 (+ 967us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.409549 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2619,"thread_start_us":2464,"threads_started":1}
I20260808 02:38:14.411545 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.387767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42621 (local address 127.10.20.67:52721)
0808 02:38:14.388795 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:14.388860 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:14.391270 (+ 2410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:14.392189 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:14.392198 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:14.392801 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:14.393451 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:14.393471 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.394819 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.394823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:14.396265 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:14.396280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.397505 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.397517 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:14.397832 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.398821 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:14.398849 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:14.401663 (+ 2814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:14.406137 (+ 4474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:14.406146 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:14.406164 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:14.406846 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:14.407359 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:14.407372 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:14.407375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:14.407663 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:14.408442 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:14.408450 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:14.408888 (+ 438us) client_negotiation.cc:769] Sending connection context
0808 02:38:14.409191 (+ 303us) client_negotiation.cc:240] Negotiation successful
0808 02:38:14.409691 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":476,"threads_started":1}
I20260808 02:38:14.413690 16737 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42621
I20260808 02:38:14.414155 16737 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:14.415220 16737 heartbeater.cc:511] Master 127.10.20.126:42621 requested a full tablet report, sending...
I20260808 02:38:14.417900 16263 ts_manager.cc:194] Registered new tserver with Master: fef0187308de431cb5e92e489ac348c8 (127.10.20.67:41043)
I20260808 02:38:14.419054 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:38:14.419068 16263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:52721
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/test-admin.keytab.
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.458456 10321 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 02:38:14.465636 16746 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:14.461786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49340 (local address 127.10.20.65:39653)
0808 02:38:14.462719 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.462733 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.463213 (+ 480us) server_negotiation.cc:407] Connection header received
0808 02:38:14.463448 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.463456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.463694 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.463876 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.465112 (+ 1236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49340: BlockingRecv error: recv got EOF from 127.0.0.1:49340 (error 108)
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":429,"threads_started":1}
W20260808 02:38:14.465844 10321 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc' of type FILE
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.467868 10321 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.469651 10321 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:38:14.494324 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.472074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49352 (local address 127.10.20.65:39653)
0808 02:38:14.472350 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.472361 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.472900 (+ 539us) server_negotiation.cc:407] Connection header received
0808 02:38:14.473330 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.473336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.473438 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.473640 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.475245 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.476401 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.477992 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.478833 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.479010 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.485180 (+ 6170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.485200 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.485216 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.485266 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.490335 (+ 5069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.491539 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.491549 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.491551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.491720 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.492318 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.492322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.492324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.492852 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.493131 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.493712 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.493997 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 02:38:14.503541 16746 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:14.501012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49368 (local address 127.10.20.65:39653)
0808 02:38:14.501355 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.501363 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.501657 (+ 294us) server_negotiation.cc:407] Connection header received
0808 02:38:14.501894 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.501899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.501982 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.502107 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.503270 (+ 1163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49368: BlockingRecv error: recv got EOF from 127.0.0.1:49368 (error 108)
Metrics: {"server-negotiator.queue_time_us":137}
W20260808 02:38:14.504066 10321 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc' of type FILE
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.506107 10321 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.507921 10321 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:38:14.527079 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.510044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49382 (local address 127.10.20.65:39653)
0808 02:38:14.510327 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.510335 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.510569 (+ 234us) server_negotiation.cc:407] Connection header received
0808 02:38:14.510798 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.510802 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.510878 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.510975 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.512113 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.512950 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.514371 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.514997 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.515177 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.519755 (+ 4578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.519762 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.519766 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.519815 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.523518 (+ 3703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.524539 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.524544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.524546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.524725 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.525301 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.525306 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.525308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.525644 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.525926 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.526337 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.526740 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
W20260808 02:38:14.533159 16746 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:14.530946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49398 (local address 127.10.20.65:39653)
0808 02:38:14.531226 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.531234 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.531567 (+ 333us) server_negotiation.cc:407] Connection header received
0808 02:38:14.531765 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.531775 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.531858 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.531968 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.532839 (+ 871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49398: BlockingRecv error: recv got EOF from 127.0.0.1:49398 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260808 02:38:14.533847 10321 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786156633487900-10321-0/krb5kdc/krb5cc)
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.535918 10321 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:14.537652 10321 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:38:14.555637 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.539486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49404 (local address 127.10.20.65:39653)
0808 02:38:14.539787 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.539798 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.540153 (+ 355us) server_negotiation.cc:407] Connection header received
0808 02:38:14.540434 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.540439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.540514 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.540638 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.541832 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.542748 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.544267 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.544761 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.544929 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.549402 (+ 4473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.549409 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.549412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.549458 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.552589 (+ 3131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.553417 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.553425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.553434 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.553597 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.554012 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.554019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.554024 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.554332 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.554747 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.555032 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.555289 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 02:38:14.557686 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16325
I20260808 02:38:14.573240 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.558583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.10.20.65:39653)
0808 02:38:14.558794 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.558801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.559300 (+ 499us) server_negotiation.cc:407] Connection header received
0808 02:38:14.559514 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.559526 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.559592 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.559700 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.560754 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.561475 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.562883 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.563370 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.563525 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.566537 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.566543 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.566547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.566590 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.569551 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.570508 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.570513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.570515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.570773 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.571311 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.571316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.571319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.571704 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.571937 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.572438 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.572734 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 02:38:14.574129 16454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:14.669643 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16325
I20260808 02:38:14.690562 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16466
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:38:14.709843 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.691661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38320 (local address 127.10.20.66:37449)
0808 02:38:14.692285 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.692293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.692318 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:38:14.692390 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.692396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.692614 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.692760 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.694039 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.695351 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.696939 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.697579 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.697701 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.702548 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.702566 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.702585 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.702639 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.706421 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.707508 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.707520 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.707523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.707698 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.708164 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.708168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.708170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.708574 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.708822 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.709267 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.709506 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":352,"threads_started":1}
I20260808 02:38:14.711382 16593 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:14.800705 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16466
I20260808 02:38:14.821360 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16604
Aug 08 02:38:14 dist-test-slave-8tdl krb5kdc[16218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:38:14.845031 16762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:14.822464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50556 (local address 127.10.20.67:41043)
0808 02:38:14.823128 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:14.823135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:14.823168 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:38:14.823230 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:14.823238 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:14.823510 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:14.823690 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:14.824850 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.825921 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.827530 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:14.828157 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:14.828309 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:14.837297 (+ 8988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:14.837322 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:14.837339 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:14.837396 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:14.840901 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.841953 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.841963 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.841966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.842176 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:14.842821 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:14.842826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:14.842828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:14.843255 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:14.843577 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:14.844082 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 02:38:14.844669 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":362,"threads_started":1}
I20260808 02:38:14.846791 16732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:14.937074 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16604
I20260808 02:38:14.956554 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16231
I20260808 02:38:14.958180 16294 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:15.070732 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16231
2026-08-08T02:38:15Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (5064 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:38:15 dist-test-slave-8tdl krb5kdc[16767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:38:15 dist-test-slave-8tdl krb5kdc[16767](info): set up 2 sockets
Aug 08 02:38:15 dist-test-slave-8tdl krb5kdc[16767](info): commencing operation
krb5kdc: starting...
W20260808 02:38:16.294821 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.009s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:38:16 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:38:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab.
Entry for principal oryx/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab.
I20260808 02:38:16.641778 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37293
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab
--principal=oryx/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:17.058736 16782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:17.059190 16782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:17.059367 16782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:17.067392 16782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:17.067585 16782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:17.067704 16782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:17.067806 16782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:17.067896 16782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:17.078926 16782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab
--principal=oryx/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:17.080514 16782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:17.082002 16782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:17.095377 16790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:17.095497 16788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:17.095739 16787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:17.096556 16782 server_base.cc:1034] running on GCE node
I20260808 02:38:17.097600 16782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:17.099423 16782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:17.100718 16782 hybrid_clock.cc:648] HybridClock initialized: now 1786156697100669 us; error 40 us; skew 500 ppm
I20260808 02:38:17.101150 16782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:17 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156697, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:17.104923 16782 init.cc:377] Logged in from keytab as oryx/127.10.20.126@KRBTEST.COM (short username oryx)
I20260808 02:38:17.106873 16782 webserver.cc:460] Webserver started at http://127.10.20.126:41519/ using document root <none> and password file <none>
I20260808 02:38:17.107694 16782 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:17.107869 16782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:17.108585 16782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:17.112968 16782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "3a68bfa28e0bb9603781c6a80f572cd9"
server_key_iv: "f0d45e9c8429e9a55328dc1d0f3a6f7f"
server_key_version: "encryptionkey@0"
I20260808 02:38:17.113924 16782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "3a68bfa28e0bb9603781c6a80f572cd9"
server_key_iv: "f0d45e9c8429e9a55328dc1d0f3a6f7f"
server_key_version: "encryptionkey@0"
I20260808 02:38:17.120481 16782 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 02:38:17.125094 16797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:17.128270 16782 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 02:38:17.128949 16782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "3a68bfa28e0bb9603781c6a80f572cd9"
server_key_iv: "f0d45e9c8429e9a55328dc1d0f3a6f7f"
server_key_version: "encryptionkey@0"
I20260808 02:38:17.129467 16782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:17.179292 16782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:17.185729 16782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:17.186228 16782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:17.211133 16782 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:37293
I20260808 02:38:17.211176 16849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:37293 every 8 connection(s)
I20260808 02:38:17.212774 16782 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:17.217460 16850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:17.223136 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16782
I20260808 02:38:17.223418 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:17.224263 10321 external_mini_cluster.cc:1428] Setting key 10429588a421934a1dabec82257d06f3
I20260808 02:38:17.235653 16850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Bootstrap starting.
I20260808 02:38:17.240988 16850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:17.242298 16850 log.cc:824] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:38:17 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:17.246812 16850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: No bootstrap required, opened a new log
I20260808 02:38:17.257055 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:17.227119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.10.20.126:37293)
0808 02:38:17.228111 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:17.228125 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:17.228175 (+ 50us) server_negotiation.cc:407] Connection header received
0808 02:38:17.230214 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:17.230246 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:17.230892 (+ 646us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:17.231329 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:17.233644 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:17.235594 (+ 1950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:17.238191 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:17.239597 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:17.239865 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:17.244606 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:17.244620 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:17.244645 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:17.244704 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:17.249799 (+ 5095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:17.251138 (+ 1339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:17.251150 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:17.251160 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:17.251476 (+ 316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:17.252201 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:17.252207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:17.252211 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:17.253460 (+ 1249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:17.253853 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:17.254413 (+ 560us) server_negotiation.cc:299] Negotiation successful
0808 02:38:17.255213 (+ 800us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":452,"threads_started":1}
I20260808 02:38:17.260532 16850 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } }
I20260808 02:38:17.261005 16850 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:17.261200 16850 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc1dd91ee5347c883ed7273ca5ebd6a, State: Initialized, Role: FOLLOWER
I20260808 02:38:17.261828 16850 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } }
I20260808 02:38:17.262243 16850 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:17.262501 16850 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:17.262755 16850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:17.265683 16850 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } }
I20260808 02:38:17.266387 16850 leader_election.cc:302] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfc1dd91ee5347c883ed7273ca5ebd6a; no voters:
I20260808 02:38:17.267325 16850 leader_election.cc:288] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:17.267498 16855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:17.268383 16855 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 LEADER]: Becoming Leader. State: Replica: bfc1dd91ee5347c883ed7273ca5ebd6a, State: Running, Role: LEADER
I20260808 02:38:17.269044 16855 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } }
I20260808 02:38:17.269869 16850 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:17.272598 16856 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } }
I20260808 02:38:17.273140 16856 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:17.274164 16857 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfc1dd91ee5347c883ed7273ca5ebd6a. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } }
I20260808 02:38:17.274773 16857 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:17.275696 16860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:17.283314 16860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:17.293601 16860 catalog_manager.cc:1347] Generated new cluster ID: 51db911a4a304f47bc1838575f906413
I20260808 02:38:17.293756 16860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:17.317057 16860 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:17.319255 16860 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:17.338838 16860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Generated new TSK 0
I20260808 02:38:17.340063 16860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab.
Entry for principal oryx/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab.
I20260808 02:38:17.434669 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37293
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:17.864054 16876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:17.864379 16876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:17.864490 16876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:17.873596 16876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:17.873741 16876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:17.873862 16876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:17.886296 16876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:17.887867 16876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:17.889312 16876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:17.905083 16882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:17.905293 16884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:17.905221 16881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:17.907121 16876 server_base.cc:1034] running on GCE node
I20260808 02:38:17.907985 16876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:17.909458 16876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:17.910993 16876 hybrid_clock.cc:648] HybridClock initialized: now 1786156697910910 us; error 66 us; skew 500 ppm
I20260808 02:38:17.911417 16876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:17 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156697, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:17.915460 16876 init.cc:377] Logged in from keytab as oryx/127.10.20.65@KRBTEST.COM (short username oryx)
I20260808 02:38:17.917378 16876 webserver.cc:460] Webserver started at http://127.10.20.65:42669/ using document root <none> and password file <none>
I20260808 02:38:17.918205 16876 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:17.918383 16876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:17.918797 16876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:17.923092 16876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "f8c7a157d8aa4525969ccdfc569f15ca"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "d7ae8745aae5150b1b94697548b1a139"
server_key_iv: "13e6f4e44310baf9d4ee3229b8192fe9"
server_key_version: "encryptionkey@0"
I20260808 02:38:17.924188 16876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "f8c7a157d8aa4525969ccdfc569f15ca"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "d7ae8745aae5150b1b94697548b1a139"
server_key_iv: "13e6f4e44310baf9d4ee3229b8192fe9"
server_key_version: "encryptionkey@0"
I20260808 02:38:17.930554 16876 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:38:17.935086 16891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:17.937127 16876 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:38:17.937363 16876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "f8c7a157d8aa4525969ccdfc569f15ca"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "d7ae8745aae5150b1b94697548b1a139"
server_key_iv: "13e6f4e44310baf9d4ee3229b8192fe9"
server_key_version: "encryptionkey@0"
I20260808 02:38:17.937606 16876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:17.957780 16876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:17.964182 16876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:17.964555 16876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:17.965776 16876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:17.967414 16876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:17.967501 16876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:17.967658 16876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:17.967720 16876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:18.010308 16876 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:43557
I20260808 02:38:18.010313 17008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:43557 every 8 connection(s)
I20260808 02:38:18.012106 16876 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:18.016753 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 16876
I20260808 02:38:18.017033 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:38:18.017880 10321 external_mini_cluster.cc:1428] Setting key fd84ad6f80cf3f2131be435f629b8b13
Aug 08 02:38:18 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156697, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:18.039284 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:18.015604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:36889 (local address 127.10.20.126:37293)
0808 02:38:18.016188 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:18.016193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:18.017451 (+ 1258us) server_negotiation.cc:407] Connection header received
0808 02:38:18.020263 (+ 2812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:18.020270 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:18.020393 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:18.020549 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:18.022632 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.023568 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.025512 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.025977 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.026143 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:18.030877 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:18.030884 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:18.030888 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:18.030942 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:18.034809 (+ 3867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:18.035855 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:18.035865 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:18.035872 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:18.036205 (+ 333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:18.036728 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:18.036736 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:18.036742 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:18.037219 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:18.037398 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:18.038368 (+ 970us) server_negotiation.cc:299] Negotiation successful
0808 02:38:18.038752 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":319,"threads_started":1}
I20260808 02:38:18.040272 17013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:18.016095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:36889)
0808 02:38:18.017235 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:18.017289 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:18.019823 (+ 2534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:18.020877 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:18.020887 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:18.021565 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:18.022351 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:18.022376 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.023813 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.023818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:18.025290 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:18.025307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.026268 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.026276 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:18.026578 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:18.027508 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:18.027537 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:18.030535 (+ 2998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:18.035087 (+ 4552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:18.035096 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:18.035113 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:18.035701 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:18.036358 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:18.036362 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:18.036364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:18.036598 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:18.037401 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:18.037409 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:18.037841 (+ 432us) client_negotiation.cc:769] Sending connection context
0808 02:38:18.038201 (+ 360us) client_negotiation.cc:240] Negotiation successful
0808 02:38:18.038831 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":444,"threads_started":1}
I20260808 02:38:18.042322 17009 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37293
I20260808 02:38:18.042771 17009 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:18.043924 17009 heartbeater.cc:511] Master 127.10.20.126:37293 requested a full tablet report, sending...
I20260808 02:38:18.047058 16814 ts_manager.cc:194] Registered new tserver with Master: f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557)
I20260808 02:38:18.048768 16814 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:36889
WARNING: no policy specified for oryx/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab.
Entry for principal oryx/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab.
I20260808 02:38:18.102873 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37293
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:18.538523 17016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:18.538964 17016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:18.539180 17016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:18.547483 17016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:18.547622 17016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:18.547809 17016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:18.559075 17016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:18.560881 17016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:18.563006 17016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:18.580327 17021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:18.580926 17024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:18.581290 17022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:18.582108 17016 server_base.cc:1034] running on GCE node
I20260808 02:38:18.583048 17016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:18.584304 17016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:18.585641 17016 hybrid_clock.cc:648] HybridClock initialized: now 1786156698585572 us; error 76 us; skew 500 ppm
I20260808 02:38:18.586396 17016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:18 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156698, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:18.591084 17016 init.cc:377] Logged in from keytab as oryx/127.10.20.66@KRBTEST.COM (short username oryx)
I20260808 02:38:18.593245 17016 webserver.cc:460] Webserver started at http://127.10.20.66:43609/ using document root <none> and password file <none>
I20260808 02:38:18.594146 17016 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:18.594349 17016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:18.594851 17016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:18.599046 17016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946"
format_stamp: "Formatted at 2026-08-08 02:38:18 on dist-test-slave-8tdl"
server_key: "7e64cf5bbd5e65a33283967862b36ac2"
server_key_iv: "cac852cde3e5d995f5e329513d9d6705"
server_key_version: "encryptionkey@0"
I20260808 02:38:18.600366 17016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946"
format_stamp: "Formatted at 2026-08-08 02:38:18 on dist-test-slave-8tdl"
server_key: "7e64cf5bbd5e65a33283967862b36ac2"
server_key_iv: "cac852cde3e5d995f5e329513d9d6705"
server_key_version: "encryptionkey@0"
I20260808 02:38:18.607007 17016 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:38:18.611652 17031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:18.613421 17016 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:38:18.613699 17016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946"
format_stamp: "Formatted at 2026-08-08 02:38:18 on dist-test-slave-8tdl"
server_key: "7e64cf5bbd5e65a33283967862b36ac2"
server_key_iv: "cac852cde3e5d995f5e329513d9d6705"
server_key_version: "encryptionkey@0"
I20260808 02:38:18.614089 17016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:18.641423 17016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:18.647264 17016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:18.647639 17016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:18.649118 17016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:18.651371 17016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:18.651506 17016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:18.652042 17016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:18.652161 17016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:18.697870 17016 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:38647
I20260808 02:38:18.697940 17147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:38647 every 8 connection(s)
I20260808 02:38:18.699484 17016 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:18.700001 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17016
I20260808 02:38:18.700254 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:38:18.700958 10321 external_mini_cluster.cc:1428] Setting key 544ee57197744f8918a9bc52489940e8
Aug 08 02:38:18 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156698, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:18.732306 17150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:18.703649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:53493 (local address 127.10.20.126:37293)
0808 02:38:18.704208 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:18.704213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:18.705524 (+ 1311us) server_negotiation.cc:407] Connection header received
0808 02:38:18.707912 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:18.707921 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:18.708032 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:18.708166 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:18.710264 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.711534 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.713733 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.714539 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.714742 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:18.721229 (+ 6487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:18.721240 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:18.721248 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:18.721308 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:18.727519 (+ 6211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:18.728879 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:18.728888 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:18.728895 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:18.729101 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:18.729728 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:18.729737 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:18.729743 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:18.730208 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:18.730404 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:18.731426 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0808 02:38:18.731780 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":319,"threads_started":1}
I20260808 02:38:18.734529 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:18.704350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:53493)
0808 02:38:18.705309 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:18.705360 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:18.707530 (+ 2170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:18.708496 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:18.708509 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:18.709297 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:18.709994 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:18.710016 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.712033 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.712039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:18.713488 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:18.713509 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:18.715061 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:18.715068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:18.715375 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:18.716573 (+ 1198us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:18.716622 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:18.720827 (+ 4205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:18.728013 (+ 7186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:18.728027 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:18.728060 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:18.728690 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:18.729268 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:18.729273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:18.729275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:18.729578 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:18.730427 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:18.730435 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:18.730952 (+ 517us) client_negotiation.cc:769] Sending connection context
0808 02:38:18.731556 (+ 604us) client_negotiation.cc:240] Negotiation successful
0808 02:38:18.732872 (+ 1316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":393,"threads_started":1}
I20260808 02:38:18.737159 17148 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37293
WARNING: no policy specified for oryx/127.10.20.67@KRBTEST.COM; defaulting to no policy
I20260808 02:38:18.737650 17148 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:18.739683 17148 heartbeater.cc:511] Master 127.10.20.126:37293 requested a full tablet report, sending...
I20260808 02:38:18.741930 16814 ts_manager.cc:194] Registered new tserver with Master: 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647)
I20260808 02:38:18.743095 16814 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:53493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab.
Entry for principal oryx/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab.
I20260808 02:38:18.794117 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37293
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:19.053901 17009 heartbeater.cc:503] Master 127.10.20.126:37293 was elected leader, sending a full tablet report...
W20260808 02:38:19.216735 17155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:19.217089 17155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:19.217274 17155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:19.226872 17155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:19.227033 17155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:19.227242 17155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:19.239282 17155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:19.241550 17155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:19.243561 17155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:19.263119 17160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:19.263897 17161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:19.264091 17163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:19.265611 17155 server_base.cc:1034] running on GCE node
I20260808 02:38:19.266451 17155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:19.268128 17155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:19.269472 17155 hybrid_clock.cc:648] HybridClock initialized: now 1786156699269367 us; error 96 us; skew 500 ppm
I20260808 02:38:19.269944 17155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:19 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156699, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:19.274504 17155 init.cc:377] Logged in from keytab as oryx/127.10.20.67@KRBTEST.COM (short username oryx)
I20260808 02:38:19.277060 17155 webserver.cc:460] Webserver started at http://127.10.20.67:42805/ using document root <none> and password file <none>
I20260808 02:38:19.278034 17155 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:19.278221 17155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:19.278592 17155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:19.284451 17155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "86752ca679164d1eb466ea3b00b02dcb"
format_stamp: "Formatted at 2026-08-08 02:38:19 on dist-test-slave-8tdl"
server_key: "8dae3a9aa47a15efecfddcea09db02e4"
server_key_iv: "84c88f542d7cae6b5738043fe8930822"
server_key_version: "encryptionkey@0"
I20260808 02:38:19.285861 17155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "86752ca679164d1eb466ea3b00b02dcb"
format_stamp: "Formatted at 2026-08-08 02:38:19 on dist-test-slave-8tdl"
server_key: "8dae3a9aa47a15efecfddcea09db02e4"
server_key_iv: "84c88f542d7cae6b5738043fe8930822"
server_key_version: "encryptionkey@0"
I20260808 02:38:19.294256 17155 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.005s
I20260808 02:38:19.299732 17170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:19.301709 17155 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:38:19.301985 17155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "86752ca679164d1eb466ea3b00b02dcb"
format_stamp: "Formatted at 2026-08-08 02:38:19 on dist-test-slave-8tdl"
server_key: "8dae3a9aa47a15efecfddcea09db02e4"
server_key_iv: "84c88f542d7cae6b5738043fe8930822"
server_key_version: "encryptionkey@0"
I20260808 02:38:19.302412 17155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:19.330639 17155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:19.336103 17155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:19.336483 17155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:19.337615 17155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:19.339293 17155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:19.339428 17155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:19.339584 17155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:19.339658 17155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:19.381172 17155 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:39419
I20260808 02:38:19.381212 17286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:39419 every 8 connection(s)
I20260808 02:38:19.382892 17155 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:19.383620 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17155
I20260808 02:38:19.384032 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:38:19.384572 10321 external_mini_cluster.cc:1428] Setting key a78410b08e503fc5c6d7f6c023f128ce
Aug 08 02:38:19 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156699, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:19.410104 17289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:19.387859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:42605 (local address 127.10.20.126:37293)
0808 02:38:19.388379 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:19.388385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:19.389743 (+ 1358us) server_negotiation.cc:407] Connection header received
0808 02:38:19.391934 (+ 2191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:19.391938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:19.392030 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:19.392131 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:19.394225 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:19.395254 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:19.397223 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:19.397727 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:19.397872 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:19.402849 (+ 4977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:19.402854 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:19.402857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:19.402896 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:19.405816 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:19.407138 (+ 1322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:19.407143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:19.407145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:19.407318 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:19.408017 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:19.408021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:19.408023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:19.408366 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:19.408531 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:19.409493 (+ 962us) server_negotiation.cc:299] Negotiation successful
0808 02:38:19.409726 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":235,"threads_started":1}
I20260808 02:38:19.411296 17290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:19.388610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:42605)
0808 02:38:19.389557 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:19.389612 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:19.391627 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:19.392425 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:19.392436 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:19.393231 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:19.393950 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:19.393973 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:19.395442 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:19.395446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:19.397011 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:19.397030 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:19.398136 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:19.398143 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:19.398388 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:19.399324 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:19.399350 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:19.402564 (+ 3214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:19.406023 (+ 3459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:19.406032 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:19.406049 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:19.406859 (+ 810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:19.407463 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:19.407467 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:19.407470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:19.407733 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:19.408533 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:19.408543 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:19.408953 (+ 410us) client_negotiation.cc:769] Sending connection context
0808 02:38:19.409320 (+ 367us) client_negotiation.cc:240] Negotiation successful
0808 02:38:19.409814 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":409,"threads_started":1}
I20260808 02:38:19.413146 17287 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37293
I20260808 02:38:19.413762 17287 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:19.414865 17287 heartbeater.cc:511] Master 127.10.20.126:37293 requested a full tablet report, sending...
I20260808 02:38:19.416780 16814 ts_manager.cc:194] Registered new tserver with Master: 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67:39419)
I20260808 02:38:19.417721 16814 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:42605
I20260808 02:38:19.430445 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.20.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.125.keytab.
Entry for principal oryx/127.10.20.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.125.keytab.
I20260808 02:38:19.513753 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:45943
--webserver_interface=127.10.20.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.125.keytab
--principal=oryx/127.10.20.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37293,127.10.20.125:45943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:19.748941 17148 heartbeater.cc:503] Master 127.10.20.126:37293 was elected leader, sending a full tablet report...
W20260808 02:38:19.941176 17294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:19.941612 17294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:19.941792 17294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:19.951709 17294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:19.951939 17294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:19.952121 17294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:19.952241 17294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:19.952334 17294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:19.968225 17294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37293,127.10.20.125:45943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.125.keytab
--principal=oryx/127.10.20.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:45943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.20.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
W20260808 02:38:19.968791 17294 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.20.126:37293,127.10.20.125:45943'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 02:38:19.970407 17294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:19.972151 17294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:19.987577 17299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:19.987912 17300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:19.987912 17302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:19.989522 17294 server_base.cc:1034] running on GCE node
I20260808 02:38:19.990509 17294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:19.992507 17294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:19.996090 17294 hybrid_clock.cc:648] HybridClock initialized: now 1786156699995967 us; error 51 us; skew 500 ppm
I20260808 02:38:19.996740 17294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:20.006448 17294 init.cc:377] Logged in from keytab as oryx/127.10.20.125@KRBTEST.COM (short username oryx)
I20260808 02:38:20.008915 17294 webserver.cc:460] Webserver started at http://127.10.20.125:35247/ using document root <none> and password file <none>
I20260808 02:38:20.010221 17294 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:20.010399 17294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:20.010923 17294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:20.015405 17294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/instance:
uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "90a0298dd8cd01627ec379c8a3e51a0c"
server_key_iv: "f431b55d0d394442f2dae9da20ae869e"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.016494 17294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal/instance:
uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "90a0298dd8cd01627ec379c8a3e51a0c"
server_key_iv: "f431b55d0d394442f2dae9da20ae869e"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.025830 17294 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s
I20260808 02:38:20.031070 17309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:20.033910 17294 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:38:20.034257 17294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "90a0298dd8cd01627ec379c8a3e51a0c"
server_key_iv: "f431b55d0d394442f2dae9da20ae869e"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.034562 17294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:20.062459 17294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:20.068663 17294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:20.068965 17294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:20.097146 17294 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.125:45943
I20260808 02:38:20.097204 17362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.125:45943 every 8 connection(s)
I20260808 02:38:20.098881 17294 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
I20260808 02:38:20.101948 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17294
I20260808 02:38:20.103729 17363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:20.115743 17363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.125@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:20.137049 17366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.105024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.10.20.125:45943)
0808 02:38:20.106395 (+ 1371us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.106415 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.106479 (+ 64us) server_negotiation.cc:407] Connection header received
0808 02:38:20.108680 (+ 2201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.108721 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.109537 (+ 816us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.110119 (+ 582us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.112358 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.114590 (+ 2232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.117262 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.118463 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.118733 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.125121 (+ 6388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.125130 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.125144 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.125197 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.129206 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.131078 (+ 1872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.131093 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.131106 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.131346 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.132427 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.132434 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.132439 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.133379 (+ 940us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.133969 (+ 590us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.134849 (+ 880us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.135410 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1063,"thread_start_us":750,"threads_started":1}
I20260808 02:38:20.139148 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.119013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.10.20.126:37293)
0808 02:38:20.119661 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.119668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.120260 (+ 592us) server_negotiation.cc:407] Connection header received
0808 02:38:20.120532 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.120539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.120635 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.120726 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.122957 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.123938 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.125979 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.126433 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.126590 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.132129 (+ 5539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.132135 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.132139 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.132191 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.135430 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.136342 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.136349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.136352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.136520 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.136992 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.136996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.136999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.137440 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.137624 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.138197 (+ 573us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.138461 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":394,"threads_started":1}
I20260808 02:38:20.139281 17369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.119059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:40300)
0808 02:38:20.120096 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.120155 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.120350 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.120874 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.120883 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.121940 (+ 1057us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:20.122622 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.122642 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.124260 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.124265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.125710 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.125733 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.126707 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.126718 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.127149 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.128021 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:20.128110 (+ 89us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:20.131530 (+ 3420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:20.135586 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.135598 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.135606 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.136147 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.136647 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.136652 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.136656 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.136845 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.137602 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:20.137610 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:20.137842 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.138073 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.138465 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":651,"threads_started":1}
I20260808 02:38:20.142023 17363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.125@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
I20260808 02:38:20.161912 17369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.143518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:59666)
0808 02:38:20.143798 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.143824 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.143976 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.144482 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.144490 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.145021 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:20.145180 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.145189 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.146587 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.146595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.148648 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.148670 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.149670 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.149676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.149827 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.150833 (+ 1006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:20.150855 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:20.153704 (+ 2849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:20.158121 (+ 4417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.158128 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.158132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.159019 (+ 887us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.159591 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.159595 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.159598 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.159756 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.160739 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:20.160744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:20.161020 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.161327 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.161631 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 02:38:20.163187 17366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.143727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.10.20.125:45943)
0808 02:38:20.143964 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.143972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.143994 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:38:20.144102 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.144107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.144202 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.144416 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.145371 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.146246 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.148897 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.149341 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.149459 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.153976 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.153982 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.153985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.154023 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.157811 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.159233 (+ 1422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.159238 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.159240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.159427 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.159939 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.159943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.159946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.160351 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.160554 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.161577 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.161798 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:38:20.169494 17363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Bootstrap starting.
I20260808 02:38:20.173569 17363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:20.175128 17363 log.cc:824] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:20.180430 17363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: No bootstrap required, opened a new log
I20260808 02:38:20.190081 17363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } }
I20260808 02:38:20.190582 17363 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:20.190747 17363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7e6ad9bef746f2ae05af9c844c0def, State: Initialized, Role: FOLLOWER
I20260808 02:38:20.191581 17363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } }
I20260808 02:38:20.192891 17371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } } }
I20260808 02:38:20.193710 17371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:20.194532 17363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:38:20.208015 17382 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:38:20.208241 17382 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:38:20.212352 17294 master_runner.cc:428] Detected that this master 2a7e6ad9bef746f2ae05af9c844c0def is joining an existing cluster
I20260808 02:38:20.212491 17294 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.20.125:45943
I20260808 02:38:20.243793 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.222356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:59678)
0808 02:38:20.223162 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.223183 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.223402 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.223930 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.223933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.224695 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:20.225097 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.225110 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.226765 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.226771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.229569 (+ 2798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.229592 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.230732 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.230747 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.230989 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.233137 (+ 2148us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:20.233160 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:20.234431 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:20.239865 (+ 5434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.239872 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.239877 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.240700 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.241257 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.241262 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.241265 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.241453 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.242301 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:20.242308 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:20.242646 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.242870 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.243257 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":479,"threads_started":1}
I20260808 02:38:20.244764 17366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.222254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59678 (local address 127.10.20.125:45943)
0808 02:38:20.222460 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.222466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.223286 (+ 820us) server_negotiation.cc:407] Connection header received
0808 02:38:20.223537 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.223542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.223623 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.223694 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.225264 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.226500 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.229733 (+ 3233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.230412 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.230619 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.234718 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.234726 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.234731 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.234776 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.239700 (+ 4924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.240874 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.240880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.240884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.241109 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.241607 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.241612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.241617 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.242040 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.242206 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.242993 (+ 787us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.243437 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":190,"server-negotiator.queue_time_us":81}
I20260808 02:38:20.250604 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.223896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40304 (local address 127.10.20.126:37293)
0808 02:38:20.224126 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.224133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.229460 (+ 5327us) server_negotiation.cc:407] Connection header received
0808 02:38:20.229563 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.229570 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.229669 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.229792 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.231727 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.232584 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.235571 (+ 2987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.236517 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.236710 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.240051 (+ 3341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.240061 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.240069 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.240125 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.246026 (+ 5901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.247349 (+ 1323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.247357 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.247361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.247567 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.248164 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.248172 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.248178 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.248793 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.249163 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.249881 (+ 718us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.250213 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 02:38:20.252748 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.223906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:40304)
0808 02:38:20.229017 (+ 5111us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.229055 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.229419 (+ 364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.230005 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.230027 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.231044 (+ 1017us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:20.231441 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.231455 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.233095 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.233102 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.235343 (+ 2241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.235361 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.236798 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.236816 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.237053 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.237850 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:20.237881 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:20.239708 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:20.246242 (+ 6534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.246249 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.246253 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.247150 (+ 897us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.247745 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.247750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.247754 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.247985 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.249279 (+ 1294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:20.249284 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:20.249546 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.251305 (+ 1759us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.251850 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4744,"thread_start_us":4357,"threads_started":1}
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156697, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.126@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
I20260808 02:38:20.283185 17366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.262962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59682 (local address 127.10.20.125:45943)
0808 02:38:20.263237 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.263248 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.264014 (+ 766us) server_negotiation.cc:407] Connection header received
0808 02:38:20.264490 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.264494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.264579 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.264706 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.266233 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.267649 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.269229 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.269755 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.269931 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.274787 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.274807 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.274811 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.274856 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.278659 (+ 3803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.280061 (+ 1402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.280070 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.280074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.280343 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.281299 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.281305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.281309 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.281704 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.281891 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.282425 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.282778 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:38:20.283246 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.262915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:59682)
0808 02:38:20.263836 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.263887 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.264209 (+ 322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.264764 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.264772 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.265527 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:20.265758 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.265768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.267859 (+ 2091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.267865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.269033 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.269051 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.269992 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.270043 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.270309 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.271402 (+ 1093us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:20.271426 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:20.274406 (+ 2980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:20.279037 (+ 4631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.279067 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.279079 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.279870 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.280919 (+ 1049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.280925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.280929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.281149 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.281872 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:20.281882 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:20.282107 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.282329 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.282776 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":519,"threads_started":1}
WARNING: no policy specified for oryx/127.10.20.124@KRBTEST.COM; defaulting to no policy
I20260808 02:38:20.286885 16814 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.20.125:45943: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
member_type: NON_VOTER
last_known_addr {
host: "127.10.20.125"
port: 45943
}
attrs {
promote: true
}
}
dest_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a"
cas_config_opid_index: -1
I20260808 02:38:20.288800 16814 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.124@KRBTEST.COM" created.
I20260808 02:38:20.302148 17337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:20.301663 17394 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } }
I20260808 02:38:20.306838 17337 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Refusing update from remote peer bfc1dd91ee5347c883ed7273ca5ebd6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 02:38:20.307590 17394 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.20.125:45943
I20260808 02:38:20.309728 17394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:20.310273 17294 master.cc:537] Master@127.10.20.125:45943 shutting down...
I20260808 02:38:20.313324 17396 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } }
I20260808 02:38:20.313773 17396 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
W20260808 02:38:20.315217 16799 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 02:38:20.319090 17371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:20.321280 17371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } }
W20260808 02:38:20.322973 17315 tablet.cc:2369] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:38:20.327718 17371 leader_election.cc:288] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293)
I20260808 02:38:20.329030 16824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" is_pre_election: true
W20260808 02:38:20.331054 16799 consensus_peers.cc:487] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a -> Peer 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125:45943): Couldn't send request to peer 2a7e6ad9bef746f2ae05af9c844c0def. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 02:38:20.331228 17313 leader_election.cc:302] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 2a7e6ad9bef746f2ae05af9c844c0def; no voters: bfc1dd91ee5347c883ed7273ca5ebd6a
I20260808 02:38:20.332032 17371 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:38:20.338176 17294 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:20.339083 17294 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:20.339356 17294 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: stopping tablet replica
I20260808 02:38:20.349280 17294 master.cc:552] Master@127.10.20.125:45943 shutdown complete.
I20260808 02:38:20.349534 17294 master_runner.cc:305] Clearing existing system tablet
I20260808 02:38:20.350023 17294 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:20.350142 17294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:20.353102 17294 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 02:38:20.355125 17402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.124.keytab.
Entry for principal oryx/127.10.20.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.124.keytab.
I20260808 02:38:20.355753 17294 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260808 02:38:20.355973 10321 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.10.20.124: real 0.110s user 0.000s sys 0.036s
I20260808 02:38:20.356110 17294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 02:38:20.356222 17294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "90a0298dd8cd01627ec379c8a3e51a0c"
server_key_iv: "f431b55d0d394442f2dae9da20ae869e"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.357370 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:44045
--webserver_interface=127.10.20.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.124.keytab
--principal=oryx/127.10.20.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:20.365839 17294 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:20.373790 17294 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 02:38:20.374063 17294 log.cc:1196] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 02:38:20.374549 17294 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Deleting consensus metadata
I20260808 02:38:20.374969 17294 master_runner.cc:315] Copying system tablet from 127.10.20.126:37293
I20260808 02:38:20.403872 17294 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: tablet copy: Beginning tablet copy session from remote peer at address 127.10.20.126:37293
I20260808 02:38:20.421609 17287 heartbeater.cc:503] Master 127.10.20.126:37293 was elected leader, sending a full tablet report...
I20260808 02:38:20.421774 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.405158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40312 (local address 127.10.20.126:37293)
0808 02:38:20.405407 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.405414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.406381 (+ 967us) server_negotiation.cc:407] Connection header received
0808 02:38:20.406737 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.406742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.406815 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.406982 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:20.408719 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.409531 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.410994 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.411469 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.411625 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.413986 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:20.413992 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:20.413995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:20.414039 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:20.417699 (+ 3660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.418727 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.418733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.418738 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.419214 (+ 476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:20.419825 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:20.419830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:20.419832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:20.420274 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:20.420471 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.421024 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.421322 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:38:20.422643 17409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.405169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:40312)
0808 02:38:20.406234 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.406257 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.406523 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.407021 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.407026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.407541 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:20.408187 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.408215 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.409720 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.409734 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.410818 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.410836 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.411650 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.411656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.411851 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.412643 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:20.412662 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:20.413711 (+ 1049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:20.417973 (+ 4262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.417982 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.417987 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.418546 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.419367 (+ 821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:20.419374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:20.419378 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:20.419617 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:20.420455 (+ 838us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:20.420460 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:20.420697 (+ 237us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.420873 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.421354 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"thread_start_us":772,"threads_started":1}
I20260808 02:38:20.424383 16834 tablet_copy_service.cc:140] P bfc1dd91ee5347c883ed7273ca5ebd6a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2a7e6ad9bef746f2ae05af9c844c0def ({username='oryx', principal='oryx/127.10.20.125@KRBTEST.COM'} at 127.0.0.1:40312)
I20260808 02:38:20.424940 16834 tablet_copy_service.cc:161] P bfc1dd91ee5347c883ed7273ca5ebd6a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2a7e6ad9bef746f2ae05af9c844c0def at {username='oryx', principal='oryx/127.10.20.125@KRBTEST.COM'} at 127.0.0.1:40312: session id = 2a7e6ad9bef746f2ae05af9c844c0def-00000000000000000000000000000000
I20260808 02:38:20.429920 16834 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 02:38:20.432425 17294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 02:38:20.438269 17294 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: tablet copy: Starting download of 0 data blocks...
I20260808 02:38:20.438663 17294 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: tablet copy: Starting download of 1 WAL segments...
I20260808 02:38:20.443325 17294 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 02:38:20.451783 16834 tablet_copy_service.cc:342] P bfc1dd91ee5347c883ed7273ca5ebd6a: Request end of tablet copy session 2a7e6ad9bef746f2ae05af9c844c0def-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.20.125@KRBTEST.COM'} at 127.0.0.1:40312
I20260808 02:38:20.452036 16834 tablet_copy_service.cc:433] P bfc1dd91ee5347c883ed7273ca5ebd6a: ending tablet copy session 2a7e6ad9bef746f2ae05af9c844c0def-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2a7e6ad9bef746f2ae05af9c844c0def
I20260808 02:38:20.468037 17294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:20.471835 17410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:20.473902 17412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:20.483084 17294 server_base.cc:1034] running on GCE node
W20260808 02:38:20.484294 17414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:20.485244 17294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:20.486135 17294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:20.487449 17294 hybrid_clock.cc:648] HybridClock initialized: now 1786156700487362 us; error 40 us; skew 500 ppm
I20260808 02:38:20.487777 17294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:20.490271 17294 init.cc:377] Logged in from keytab as oryx/127.10.20.125@KRBTEST.COM (short username oryx)
I20260808 02:38:20.495956 17294 webserver.cc:460] Webserver started at http://127.10.20.125:35183/ using document root <none> and password file <none>
I20260808 02:38:20.496590 17294 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:20.496696 17294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:20.499603 17294 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 02:38:20.503131 17421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:20.503726 17294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 02:38:20.503919 17294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "90a0298dd8cd01627ec379c8a3e51a0c"
server_key_iv: "f431b55d0d394442f2dae9da20ae869e"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.504114 17294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:20.537853 17294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:20.543093 17294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:20.583498 17294 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.125:45943
I20260808 02:38:20.583547 17474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.125:45943 every 8 connection(s)
I20260808 02:38:20.584689 17294 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
I20260808 02:38:20.592743 17475 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:38:20.596343 17475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Bootstrap starting.
I20260808 02:38:20.613849 17475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:38:20.614931 17475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: Bootstrap complete.
I20260808 02:38:20.616079 17475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } }
I20260808 02:38:20.616381 17475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a7e6ad9bef746f2ae05af9c844c0def, State: Initialized, Role: LEARNER
I20260808 02:38:20.616657 17475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } }
I20260808 02:38:20.617645 17478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } }
I20260808 02:38:20.618208 17478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: LEARNER
I20260808 02:38:20.618209 17475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:20.631233 17490 catalog_manager.cc:1259] Loaded cluster ID: 51db911a4a304f47bc1838575f906413
I20260808 02:38:20.631397 17490 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: loading cluster ID for follower catalog manager: success
I20260808 02:38:20.634582 17490 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: acquiring CA information for follower catalog manager: success
I20260808 02:38:20.638159 17490 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:38:20.701153 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.692744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:59696)
0808 02:38:20.693047 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:20.693071 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:20.693239 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:20.694251 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:20.694258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:20.694289 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:20.694487 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.694497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.695977 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.695985 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.697668 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:20.697686 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.700217 (+ 2531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.700224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:20.700475 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.700584 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 02:38:20.700674 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 02:38:20.700841 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166}
I20260808 02:38:20.702895 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:20.692887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59696 (local address 127.10.20.125:45943)
0808 02:38:20.693869 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:20.693874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:20.693896 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:38:20.693962 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:20.693965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:20.694037 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:20.694198 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:20.694652 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.695796 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.697857 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:20.699936 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:20.701943 (+ 2007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:20.702211 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:20.702285 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 02:38:20.702462 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":659,"threads_started":1}
I20260808 02:38:20.704254 17449 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 02:38:20.704941 17478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfc1dd91ee5347c883ed7273ca5ebd6a. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } }
I20260808 02:38:20.705238 17478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: LEARNER
W20260808 02:38:20.890993 17403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:20.891345 17403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:20.891513 17403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:20.899646 17403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:20.899802 17403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:20.899859 17403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:20.899952 17403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:20.900029 17403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:20.911669 17403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.124.keytab
--principal=oryx/127.10.20.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:44045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.20.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:20.913368 17403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:20.915037 17403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:20.933540 17496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:20.933650 17497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:20.935324 17403 server_base.cc:1034] running on GCE node
W20260808 02:38:20.935428 17499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:20.936662 17403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:20.938555 17403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:20.939976 17403 hybrid_clock.cc:648] HybridClock initialized: now 1786156700939898 us; error 51 us; skew 500 ppm
I20260808 02:38:20.940629 17403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:20 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:20.945223 17403 init.cc:377] Logged in from keytab as oryx/127.10.20.124@KRBTEST.COM (short username oryx)
I20260808 02:38:20.947243 17403 webserver.cc:460] Webserver started at http://127.10.20.124:37365/ using document root <none> and password file <none>
I20260808 02:38:20.948312 17403 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:20.948484 17403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:20.948822 17403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:20.953269 17403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/instance:
uuid: "97e0419767324365898711591ae0de53"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "eae398bd9927d62ffad1a635874f05d6"
server_key_iv: "1ad77390ac0c4f0368368679bad42a71"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.954433 17403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal/instance:
uuid: "97e0419767324365898711591ae0de53"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "eae398bd9927d62ffad1a635874f05d6"
server_key_iv: "1ad77390ac0c4f0368368679bad42a71"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.961633 17403 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 02:38:20.967029 17506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:20.968914 17403 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:38:20.969177 17403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
uuid: "97e0419767324365898711591ae0de53"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "eae398bd9927d62ffad1a635874f05d6"
server_key_iv: "1ad77390ac0c4f0368368679bad42a71"
server_key_version: "encryptionkey@0"
I20260808 02:38:20.969444 17403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:20.998557 17403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:21.003959 17403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:21.004316 17403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:21.030268 17403 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.124:44045
I20260808 02:38:21.030267 17558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.124:44045 every 8 connection(s)
I20260808 02:38:21.032194 17403 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
I20260808 02:38:21.036111 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17403
I20260808 02:38:21.037117 17559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:21.047711 17559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.124@KRBTEST.COM
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.124@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:21.065624 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.038982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52852 (local address 127.10.20.124:44045)
0808 02:38:21.039908 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.039925 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.039979 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:38:21.041595 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.041620 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.042110 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.042785 (+ 675us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.044506 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.046127 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.047562 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.048897 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.049135 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.055650 (+ 6515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.055660 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.055672 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.055719 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.060045 (+ 4326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.061041 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.061049 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.061057 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.061307 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.061846 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.061852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.061855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.062570 (+ 715us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.062930 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.063482 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.063962 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":423,"threads_started":1}
I20260808 02:38:21.070326 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.051629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:40318)
0808 02:38:21.052829 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.052869 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.053161 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.053688 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.053696 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.054465 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.054995 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.055008 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.056154 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.056160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.057731 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.057752 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.058576 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.058583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.058800 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.059480 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.059500 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.062798 (+ 3298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.067054 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.067066 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.067073 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.067780 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.068302 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.068306 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.068310 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.068495 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.069365 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.069371 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.069575 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.069749 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.070023 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"thread_start_us":775,"threads_started":1}
I20260808 02:38:21.070855 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.051856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40318 (local address 127.10.20.126:37293)
0808 02:38:21.052463 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.052471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.053043 (+ 572us) server_negotiation.cc:407] Connection header received
0808 02:38:21.053313 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.053323 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.053391 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.053606 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.055197 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.055994 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.057936 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.058366 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.058519 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.063034 (+ 4515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.063039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.063043 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.063077 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.066890 (+ 3813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.068011 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.068016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.068019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.068174 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.068625 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.068629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.068631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.069172 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.069369 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.069944 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.070163 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":337,"threads_started":1}
I20260808 02:38:21.072324 17559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.124@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
I20260808 02:38:21.089294 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.073219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:59706)
0808 02:38:21.073458 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.073477 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.073587 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.074194 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.074199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.074647 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.074873 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.074882 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.076070 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.076082 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.077159 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.077174 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.077980 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.077988 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.078173 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.079013 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.079035 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.081975 (+ 2940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.086392 (+ 4417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.086398 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.086403 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.086977 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.087431 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.087437 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.087440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.087639 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.088207 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.088212 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.088384 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.088538 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.088924 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 02:38:21.089294 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.073574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.10.20.125:45943)
0808 02:38:21.073893 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.073898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.073912 (+ 14us) server_negotiation.cc:407] Connection header received
0808 02:38:21.073964 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.073967 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.074029 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.074143 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.075135 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.075893 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.077328 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.077786 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.077954 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.082485 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.082492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.082496 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.082538 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.086178 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.087121 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.087127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.087130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.087295 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.087770 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.087774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.087776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.088079 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.088248 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.088646 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.088923 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260808 02:38:21.090867 17559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156700, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.124@KRBTEST.COM for oryx/127.10.20.124@KRBTEST.COM
I20260808 02:38:21.107888 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.091700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.0.0.1:52864)
0808 02:38:21.091958 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.091977 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.092073 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.092429 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.092433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.092849 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.093014 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.093024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.094394 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.094407 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.095433 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.095448 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.096293 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.096297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.096467 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.097223 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.097244 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.099832 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.103870 (+ 4038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.103877 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.103881 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.105016 (+ 1135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.105674 (+ 658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.105678 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.105681 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.105947 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.106667 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.106754 (+ 87us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.107069 (+ 315us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.107250 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.107531 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 02:38:21.108207 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.091813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52864 (local address 127.10.20.124:44045)
0808 02:38:21.091995 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.091999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.092020 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:38:21.092198 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.092202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.092260 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.092345 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.093260 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.094017 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.095633 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.096050 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.096157 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.100245 (+ 4088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.100252 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.100255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.100357 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.103570 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.105217 (+ 1647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.105222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.105225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.105532 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.106137 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.106145 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.106148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.106491 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.106633 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.107458 (+ 825us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.107691 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:38:21.114033 17559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Bootstrap starting.
I20260808 02:38:21.118598 17559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:21.120445 17559 log.cc:824] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:21.124953 17559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: No bootstrap required, opened a new log
I20260808 02:38:21.133719 17559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } }
I20260808 02:38:21.134292 17559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:21.134557 17559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e0419767324365898711591ae0de53, State: Initialized, Role: FOLLOWER
I20260808 02:38:21.135573 17559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } }
I20260808 02:38:21.136767 17566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } } }
I20260808 02:38:21.137223 17566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:21.137938 17559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:38:21.150857 17578 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:38:21.151050 17578 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:38:21.157759 17403 master_runner.cc:428] Detected that this master 97e0419767324365898711591ae0de53 is joining an existing cluster
I20260808 02:38:21.157954 17403 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.20.124:44045
I20260808 02:38:21.176608 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16876
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.65@KRBTEST.COM
I20260808 02:38:21.196730 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.165660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40334 (local address 127.10.20.126:37293)
0808 02:38:21.165880 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.165887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.167746 (+ 1859us) server_negotiation.cc:407] Connection header received
0808 02:38:21.168313 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.168324 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.168470 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.168572 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.170977 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.173111 (+ 2134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.181670 (+ 8559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.182484 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.182603 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.186795 (+ 4192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.186805 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.186811 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.186869 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.191216 (+ 4347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.192718 (+ 1502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.192725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.192730 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.192946 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.193518 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.193524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.193528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.193955 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.194139 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.195543 (+ 1404us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.195864 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:38:21.201135 17585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.166510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:40334)
0808 02:38:21.167620 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.167642 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.168060 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.168881 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.168890 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.170090 (+ 1200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.170663 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.170715 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.177947 (+ 7232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.177953 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.181433 (+ 3480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.181451 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.182984 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.182992 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.183205 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.184753 (+ 1548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.184779 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.186229 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.191450 (+ 5221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.191456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.191460 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.192498 (+ 1038us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.193130 (+ 632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.193135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.193139 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.193351 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.194512 (+ 1161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.194523 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.194852 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.195058 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.200581 (+ 5523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"thread_start_us":663,"threads_started":1}
I20260808 02:38:21.201444 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.165728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59718 (local address 127.10.20.125:45943)
0808 02:38:21.165970 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.165978 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.167092 (+ 1114us) server_negotiation.cc:407] Connection header received
0808 02:38:21.167491 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.167499 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.167614 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.167700 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.169612 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.171014 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.173505 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.174328 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.174467 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.180591 (+ 6124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.180599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.180605 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.180659 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.185250 (+ 4591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.197641 (+ 12391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.197649 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.197655 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.197931 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.198703 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.198711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.198716 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.199552 (+ 836us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.199717 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.200720 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.201040 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:38:21.203291 17584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.165741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:59718)
0808 02:38:21.166890 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.166913 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.167274 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.167978 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.167984 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.168881 (+ 897us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.169370 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.169387 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.171284 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.171290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.173256 (+ 1966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.173277 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.175556 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.175563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.175775 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.176631 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.176660 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.180280 (+ 3620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.185501 (+ 5221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.185508 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.185516 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.194334 (+ 8818us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.198130 (+ 3796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.198137 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.198141 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.198392 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.200042 (+ 1650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.200048 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.200345 (+ 297us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.202369 (+ 2024us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.202782 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"thread_start_us":742,"threads_started":1}
I20260808 02:38:21.204105 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.167803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52870 (local address 127.10.20.124:44045)
0808 02:38:21.168005 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.168012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.175061 (+ 7049us) server_negotiation.cc:407] Connection header received
0808 02:38:21.175749 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.175775 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.175868 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.175952 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.186230 (+ 10278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.187561 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.190055 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.190980 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.191108 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.194380 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.194390 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.194396 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.194438 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.199133 (+ 4695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.201414 (+ 2281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.201420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.201423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.201611 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.202180 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.202186 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.202190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.202718 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.202868 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.203468 (+ 600us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.203729 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 02:38:21.205199 17586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.167998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.0.0.1:52870)
0808 02:38:21.174943 (+ 6945us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.174966 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.175554 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.176286 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.176292 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.177527 (+ 1235us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.184510 (+ 6983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.184564 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.187884 (+ 3320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.187889 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.189830 (+ 1941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.189857 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.191515 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.191526 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.191747 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.192638 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.192665 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.194133 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.199617 (+ 5484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.199623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.199626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.200327 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.201759 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.201764 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.201768 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.201938 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.202957 (+ 1019us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.202963 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.203163 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.204352 (+ 1189us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.204678 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6709,"thread_start_us":7084,"threads_started":1}
I20260808 02:38:21.210295 17587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.178186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36790 (local address 127.10.20.65:43557)
0808 02:38:21.179378 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.179387 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.179425 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:38:21.179533 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.179546 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.179888 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.182294 (+ 2406us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.182645 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.184362 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.186701 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.187729 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.192253 (+ 4524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.194630 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.194655 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.194702 (+ 47us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.194756 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.200688 (+ 5932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.205935 (+ 5247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.205949 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.205955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.206216 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.207014 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.207020 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.207023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.207625 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.209250 (+ 1625us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.209477 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.209824 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":472,"threads_started":1}
I20260808 02:38:21.211977 17004 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156697, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.126@KRBTEST.COM for oryx/127.10.20.124@KRBTEST.COM
I20260808 02:38:21.233651 17566 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:21.234009 17566 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } }
I20260808 02:38:21.235790 17566 leader_election.cc:288] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293), 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125:45943)
I20260808 02:38:21.236690 16824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97e0419767324365898711591ae0de53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" is_pre_election: true
I20260808 02:38:21.237504 17449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97e0419767324365898711591ae0de53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" is_pre_election: true
I20260808 02:38:21.238987 17510 leader_election.cc:302] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97e0419767324365898711591ae0de53; no voters: 2a7e6ad9bef746f2ae05af9c844c0def, bfc1dd91ee5347c883ed7273ca5ebd6a
I20260808 02:38:21.239452 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.209513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52880 (local address 127.10.20.124:44045)
0808 02:38:21.209682 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.209690 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.210197 (+ 507us) server_negotiation.cc:407] Connection header received
0808 02:38:21.210428 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.210434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.210535 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.210667 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.211842 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.213331 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.216228 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.217227 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.217376 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.225013 (+ 7637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.225025 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.225033 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.225104 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.230999 (+ 5895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.232710 (+ 1711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.232719 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.232726 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.232951 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.233686 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.233695 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.233700 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.234544 (+ 844us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.234782 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.235732 (+ 950us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.239061 (+ 3329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:38:21.239835 17588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.209423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.0.0.1:52880)
0808 02:38:21.210068 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.210089 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.210241 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.210779 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.210784 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.211292 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.211645 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.211660 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.213711 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.213720 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.215920 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.215947 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.217769 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.217779 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.218050 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.219533 (+ 1483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.219571 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.224396 (+ 4825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.231488 (+ 7092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.231498 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.231505 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.232304 (+ 799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.233227 (+ 923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.233235 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.233242 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.233456 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.234988 (+ 1532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.234997 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.235295 (+ 298us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.239044 (+ 3749us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.239423 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":402,"threads_started":1}
I20260808 02:38:21.239859 17566 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 02:38:21.241572 16814 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.20.124:44045: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "97e0419767324365898711591ae0de53"
member_type: NON_VOTER
last_known_addr {
host: "127.10.20.124"
port: 44045
}
attrs {
promote: true
}
}
dest_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a"
cas_config_opid_index: 5
I20260808 02:38:21.242802 16814 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } }
W20260808 02:38:21.257797 17512 tablet.cc:2369] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:38:21.262547 17534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:21.263218 17590 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 97e0419767324365898711591ae0de53 (127.10.20.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.267722 17534 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Refusing update from remote peer bfc1dd91ee5347c883ed7273ca5ebd6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 02:38:21.280494 17449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 LEARNER]: Refusing update from remote peer bfc1dd91ee5347c883ed7273ca5ebd6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 02:38:21.284210 17594 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 02:38:21.286849 17590 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.20.124:44045
I20260808 02:38:21.288022 17593 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 02:38:21.293284 17403 master.cc:537] Master@127.10.20.124:44045 shutting down...
I20260808 02:38:21.297741 17449 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 97e0419767324365898711591ae0de53 (127.10.20.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.313021 17598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.314904 17598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: LEARNER
W20260808 02:38:21.318730 16801 consensus_peers.cc:487] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a -> Peer 97e0419767324365898711591ae0de53 (127.10.20.124:44045): Couldn't send request to peer 97e0419767324365898711591ae0de53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 02:38:21.323591 17594 raft_consensus.cc:1050] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: attempting to promote NON_VOTER 2a7e6ad9bef746f2ae05af9c844c0def to VOTER
I20260808 02:38:21.324766 17594 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } }
I20260808 02:38:21.325500 17403 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:21.325939 17403 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:21.326152 17403 tablet_replica.cc:330] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: stopping tablet replica
I20260808 02:38:21.327365 17449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 LEARNER]: Refusing update from remote peer bfc1dd91ee5347c883ed7273ca5ebd6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 02:38:21.327107 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.327515 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:21.327912 17591 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: NON_VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: true } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.328171 17592 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 02:38:21.328469 17591 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
W20260808 02:38:21.329463 16801 consensus_peers.cc:487] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a -> Peer 97e0419767324365898711591ae0de53 (127.10.20.124:44045): Couldn't send request to peer 97e0419767324365898711591ae0de53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 02:38:21.331574 17590 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.335625 17449 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.337610 17403 master.cc:552] Master@127.10.20.124:44045 shutdown complete.
I20260808 02:38:21.337708 17403 master_runner.cc:305] Clearing existing system tablet
I20260808 02:38:21.338171 17403 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:21.338294 17403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:21.341629 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.341991 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:21.342324 17593 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.342643 17593 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:21.343298 17598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.343735 17598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:21.347662 17403 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.000s sys 0.008s
I20260808 02:38:21.355257 17602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:21.355804 17403 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:21.356158 17403 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.004s
I20260808 02:38:21.356284 17403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
uuid: "97e0419767324365898711591ae0de53"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "eae398bd9927d62ffad1a635874f05d6"
server_key_iv: "1ad77390ac0c4f0368368679bad42a71"
server_key_version: "encryptionkey@0"
I20260808 02:38:21.362749 17403 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:21.373589 17403 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 02:38:21.373836 17403 log.cc:1196] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 02:38:21.374912 17403 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Deleting consensus metadata
I20260808 02:38:21.375298 17403 master_runner.cc:315] Copying system tablet from 127.10.20.126:37293
I20260808 02:38:21.379681 17403 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: tablet copy: Beginning tablet copy session from remote peer at address 127.10.20.126:37293
I20260808 02:38:21.401293 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.381897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:40348)
0808 02:38:21.385255 (+ 3358us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.385285 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.385508 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.385976 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.385981 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.386630 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:21.386975 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.386987 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.388616 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.388622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.390237 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.390256 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.391348 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.391355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.391543 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.392306 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:21.392329 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:21.393624 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:21.398008 (+ 4384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.398015 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.398019 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.398609 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.399219 (+ 610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:21.399224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:21.399228 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:21.399440 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:21.400158 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:21.400162 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:21.400375 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.400528 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.400871 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3197,"thread_start_us":2986,"threads_started":1}
I20260808 02:38:21.401679 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.384438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.10.20.126:37293)
0808 02:38:21.384735 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.384742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.385434 (+ 692us) server_negotiation.cc:407] Connection header received
0808 02:38:21.385674 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.385681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.385777 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.385903 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:21.387164 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.388413 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.390430 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.391147 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.391292 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.393876 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:21.393884 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:21.393890 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:21.393933 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:21.397809 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.398784 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.398790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.398794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.398965 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:21.399580 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:21.399585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:21.399589 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:21.400013 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:21.400177 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.400694 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.400964 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260808 02:38:21.402472 16834 tablet_copy_service.cc:140] P bfc1dd91ee5347c883ed7273ca5ebd6a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 97e0419767324365898711591ae0de53 ({username='oryx', principal='oryx/127.10.20.124@KRBTEST.COM'} at 127.0.0.1:40348)
I20260808 02:38:21.402721 16834 tablet_copy_service.cc:161] P bfc1dd91ee5347c883ed7273ca5ebd6a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 97e0419767324365898711591ae0de53 at {username='oryx', principal='oryx/127.10.20.124@KRBTEST.COM'} at 127.0.0.1:40348: session id = 97e0419767324365898711591ae0de53-00000000000000000000000000000000
I20260808 02:38:21.405455 16834 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 02:38:21.407907 17403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 02:38:21.408629 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16876
I20260808 02:38:21.416980 17403 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: tablet copy: Starting download of 0 data blocks...
I20260808 02:38:21.417397 17403 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: tablet copy: Starting download of 1 WAL segments...
I20260808 02:38:21.421142 17403 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 02:38:21.427846 16834 tablet_copy_service.cc:342] P bfc1dd91ee5347c883ed7273ca5ebd6a: Request end of tablet copy session 97e0419767324365898711591ae0de53-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.20.124@KRBTEST.COM'} at 127.0.0.1:40348
I20260808 02:38:21.428064 16834 tablet_copy_service.cc:433] P bfc1dd91ee5347c883ed7273ca5ebd6a: ending tablet copy session 97e0419767324365898711591ae0de53-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 97e0419767324365898711591ae0de53
I20260808 02:38:21.439200 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:43557
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:37293
--webserver_port=42669
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:21.444383 17403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:21.447861 17609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:21.448663 17610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:21.456357 17612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:21.459714 17403 server_base.cc:1034] running on GCE node
I20260808 02:38:21.460290 17403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:21.461429 17403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:21.462653 17403 hybrid_clock.cc:648] HybridClock initialized: now 1786156701462601 us; error 55 us; skew 500 ppm
I20260808 02:38:21.463032 17403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:21 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156701, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:21.465641 17403 init.cc:377] Logged in from keytab as oryx/127.10.20.124@KRBTEST.COM (short username oryx)
I20260808 02:38:21.467799 17403 webserver.cc:460] Webserver started at http://127.10.20.124:43061/ using document root <none> and password file <none>
I20260808 02:38:21.468405 17403 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:21.468602 17403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:21.472373 17403 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 02:38:21.474861 17620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:21.475468 17403 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 02:38:21.475668 17403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
uuid: "97e0419767324365898711591ae0de53"
format_stamp: "Formatted at 2026-08-08 02:38:20 on dist-test-slave-8tdl"
server_key: "eae398bd9927d62ffad1a635874f05d6"
server_key_iv: "1ad77390ac0c4f0368368679bad42a71"
server_key_version: "encryptionkey@0"
I20260808 02:38:21.475953 17403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:21.491765 17403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:21.496526 17403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:21.549348 17403 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.124:44045
I20260808 02:38:21.549404 17673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.124:44045 every 8 connection(s)
I20260808 02:38:21.550732 17403 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
I20260808 02:38:21.556756 17674 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:38:21.561733 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Bootstrap starting.
I20260808 02:38:21.585968 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:38:21.586624 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Bootstrap complete.
I20260808 02:38:21.587975 17674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } }
I20260808 02:38:21.588303 17674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 97e0419767324365898711591ae0de53, State: Initialized, Role: LEARNER
I20260808 02:38:21.588608 17674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } }
I20260808 02:38:21.606055 17677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.606562 17674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:21.606660 17677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: This master's current role is: LEARNER
I20260808 02:38:21.619585 17688 catalog_manager.cc:1259] Loaded cluster ID: 51db911a4a304f47bc1838575f906413
I20260808 02:38:21.619763 17688 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: loading cluster ID for follower catalog manager: success
I20260808 02:38:21.623417 17688 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: acquiring CA information for follower catalog manager: success
I20260808 02:38:21.626173 17688 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:38:21.773178 17689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.749344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.0.0.1:52890)
0808 02:38:21.762876 (+ 13532us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:21.762906 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:21.763134 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:21.764593 (+ 1459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:21.764599 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:21.764639 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:21.764915 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.764929 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.767532 (+ 2603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.767539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.769674 (+ 2135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:21.769722 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.772241 (+ 2519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.772249 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:21.772470 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.772511 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 02:38:21.772631 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 02:38:21.772798 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13370,"thread_start_us":13900,"threads_started":1}
I20260808 02:38:21.773240 17690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:21.749833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.10.20.124:44045)
0808 02:38:21.764034 (+ 14201us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:21.764044 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:21.764073 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:38:21.764180 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:21.764189 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:21.764338 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:21.764526 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:21.765153 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.767266 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.770008 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:21.771926 (+ 1918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:21.772150 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:21.772536 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:21.772667 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 02:38:21.772825 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13994,"thread_start_us":13794,"threads_started":1}
I20260808 02:38:21.774773 17648 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 02:38:21.775528 17677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfc1dd91ee5347c883ed7273ca5ebd6a. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:21.775816 17677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: This master's current role is: LEARNER
W20260808 02:38:21.956394 17614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:21.956784 17614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:21.956964 17614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:21.965975 17614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:21.966207 17614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:21.966408 17614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:21.980161 17614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:43557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=42669
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:21.981825 17614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:21.983817 17614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:22.004781 17698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:22.004678 17695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:22.004732 17696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:22.006325 17614 server_base.cc:1034] running on GCE node
I20260808 02:38:22.007301 17614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:22.010147 17614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:22.011521 17614 hybrid_clock.cc:648] HybridClock initialized: now 1786156702011438 us; error 76 us; skew 500 ppm
I20260808 02:38:22.011951 17614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:22.017177 17614 init.cc:377] Logged in from keytab as oryx/127.10.20.65@KRBTEST.COM (short username oryx)
I20260808 02:38:22.019886 17614 webserver.cc:460] Webserver started at http://127.10.20.65:42669/ using document root <none> and password file <none>
I20260808 02:38:22.020851 17614 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:22.021030 17614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:22.028275 17614 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:38:22.032006 17705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:22.034183 17614 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:38:22.034397 17614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "f8c7a157d8aa4525969ccdfc569f15ca"
format_stamp: "Formatted at 2026-08-08 02:38:17 on dist-test-slave-8tdl"
server_key: "d7ae8745aae5150b1b94697548b1a139"
server_key_iv: "13e6f4e44310baf9d4ee3229b8192fe9"
server_key_version: "encryptionkey@0"
I20260808 02:38:22.036373 17614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:22.109652 17614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:22.115832 17614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:22.116290 17614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:22.117861 17614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:22.120384 17614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:22.120517 17614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:22.120610 17614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:22.120663 17614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:22.173348 17614 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:43557
I20260808 02:38:22.173482 17821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:43557 every 8 connection(s)
I20260808 02:38:22.175242 17614 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:22.181552 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17614
I20260808 02:38:22.181957 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17016
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.124@KRBTEST.COM
I20260808 02:38:22.217041 17827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.180181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.10.20.65:39483)
0808 02:38:22.181427 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:22.181511 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:22.185300 (+ 3789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:22.187081 (+ 1781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:22.187103 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:22.189233 (+ 2130us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:22.190565 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.190609 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.193287 (+ 2678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.193299 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.198753 (+ 5454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.198787 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.200286 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.200293 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.200539 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.201365 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:22.201393 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:22.204898 (+ 3505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:22.211163 (+ 6265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:22.211173 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:22.211192 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:22.211951 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:22.212570 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:22.212576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:22.212580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:22.212855 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:22.213749 (+ 894us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:22.213758 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:22.214307 (+ 549us) client_negotiation.cc:769] Sending connection context
0808 02:38:22.214835 (+ 528us) client_negotiation.cc:240] Negotiation successful
0808 02:38:22.215461 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":558,"threads_started":1}
I20260808 02:38:22.218602 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.179083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:39483 (local address 127.10.20.125:45943)
0808 02:38:22.179987 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.179996 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.181670 (+ 1674us) server_negotiation.cc:407] Connection header received
0808 02:38:22.185906 (+ 4236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.185916 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.186048 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.186155 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.190999 (+ 4844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.192671 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.199085 (+ 6414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.199732 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.199883 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.205295 (+ 5412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:22.205304 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:22.205310 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:22.205361 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:22.210881 (+ 5520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.212148 (+ 1267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.212155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.212158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.212416 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.213069 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.213075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.213078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.213525 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:22.213669 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:22.217870 (+ 4201us) server_negotiation.cc:299] Negotiation successful
0808 02:38:22.218164 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":515,"threads_started":1}
I20260808 02:38:22.222028 17824 heartbeater.cc:347] Connected to a master server at 127.10.20.125:45943
I20260808 02:38:22.222450 17824 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:22.223551 17824 heartbeater.cc:511] Master 127.10.20.125:45943 requested a full tablet report, sending...
I20260808 02:38:22.228413 17439 ts_manager.cc:194] Registered new tserver with Master: f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557)
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.66@KRBTEST.COM
I20260808 02:38:22.234820 17690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.178995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:57513 (local address 127.10.20.124:44045)
0808 02:38:22.179225 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.179234 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.181664 (+ 2430us) server_negotiation.cc:407] Connection header received
0808 02:38:22.201313 (+ 19649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.201324 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.201463 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.201573 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.203943 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.205110 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.211129 (+ 6019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.212006 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.212175 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.217113 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:22.217123 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:22.217127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:22.217178 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:22.231087 (+ 13909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.232161 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.232168 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.232171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.232385 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.232937 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.232945 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.232952 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.233327 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:22.233514 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:22.234067 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 02:38:22.234348 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:38:22.234998 17828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.180310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.10.20.65:57513)
0808 02:38:22.181427 (+ 1117us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:22.181521 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:22.200707 (+ 19186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:22.201971 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:22.201976 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:22.202981 (+ 1005us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:22.203667 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.203697 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.206931 (+ 3234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.206941 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.208896 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.208927 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.212528 (+ 3601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.212540 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.212794 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.213571 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:22.213596 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:22.216806 (+ 3210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:22.231342 (+ 14536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:22.231348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:22.231353 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:22.231978 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:22.232531 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:22.232536 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:22.232539 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:22.232780 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:22.233471 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:22.233476 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:22.233711 (+ 235us) client_negotiation.cc:769] Sending connection context
0808 02:38:22.233957 (+ 246us) client_negotiation.cc:240] Negotiation successful
0808 02:38:22.234319 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"spinlock_wait_cycles":76160,"thread_start_us":2279,"threads_started":1}
I20260808 02:38:22.236454 17822 heartbeater.cc:347] Connected to a master server at 127.10.20.124:44045
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:22.236649 17822 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:22.237179 17822 heartbeater.cc:511] Master 127.10.20.124:44045 requested a full tablet report, sending...
I20260808 02:38:22.239492 17637 ts_manager.cc:194] Registered new tserver with Master: f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557)
I20260808 02:38:22.243938 17832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.183295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49950 (local address 127.10.20.66:38647)
0808 02:38:22.210541 (+ 27246us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.210551 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.210592 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:38:22.210726 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.210736 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.211105 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.213992 (+ 2887us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.214303 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.216694 (+ 2391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.219064 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.221240 (+ 2176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.225402 (+ 4162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.232501 (+ 7099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:22.232524 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:22.232544 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:22.232605 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:22.238300 (+ 5695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.240722 (+ 2422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.240732 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.240735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.240913 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.241723 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.241729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.241733 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.242180 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:22.242453 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:22.242960 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 02:38:22.243316 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27015,"thread_start_us":26849,"threads_started":1}
I20260808 02:38:22.245668 17143 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:22.249270 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: NON_VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: true } } }
I20260808 02:38:22.250656 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:22.251022 17827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.183249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:53573)
0808 02:38:22.219231 (+ 35982us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:22.219254 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:22.219397 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:22.220759 (+ 1362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:22.220766 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:22.221347 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:22.221657 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.221672 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.224680 (+ 3008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.224688 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.226968 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.226991 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.232233 (+ 5242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.232241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.232470 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.233182 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:22.233211 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:22.237640 (+ 4429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:22.242815 (+ 5175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:22.242821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:22.242825 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:22.243422 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:22.243886 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:22.243897 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:22.243901 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:22.244088 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:22.246853 (+ 2765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:22.246862 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:22.247145 (+ 283us) client_negotiation.cc:769] Sending connection context
0808 02:38:22.247342 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 02:38:22.248069 (+ 727us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35857,"thread_start_us":47447,"threads_started":1}
I20260808 02:38:22.250298 17833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.183874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:53573 (local address 127.10.20.126:37293)
0808 02:38:22.209846 (+ 25972us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.209855 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.219337 (+ 9482us) server_negotiation.cc:407] Connection header received
0808 02:38:22.219761 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.219771 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.219891 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.220023 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.221847 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.223526 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.230863 (+ 7337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.231585 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.231741 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.237898 (+ 6157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:22.237907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:22.237912 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:22.237971 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:22.242315 (+ 4344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.243594 (+ 1279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.243601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.243603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.243750 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:22.245338 (+ 1588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:22.245344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:22.245347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:22.245807 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:22.246022 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:22.249117 (+ 3095us) server_negotiation.cc:299] Negotiation successful
0808 02:38:22.249783 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25617,"thread_start_us":25487,"threads_started":1}
I20260808 02:38:22.259641 17823 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37293
I20260808 02:38:22.259896 17823 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:22.260528 17823 heartbeater.cc:511] Master 127.10.20.126:37293 requested a full tablet report, sending...
I20260808 02:38:22.262275 16814 ts_manager.cc:194] Re-registered known tserver with Master: f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557)
I20260808 02:38:22.263847 16814 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:53573
I20260808 02:38:22.265004 17836 raft_consensus.cc:1050] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: attempting to promote NON_VOTER 97e0419767324365898711591ae0de53 to VOTER
I20260808 02:38:22.265727 17836 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } }
I20260808 02:38:22.268283 17648 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 LEARNER]: Refusing update from remote peer bfc1dd91ee5347c883ed7273ca5ebd6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 02:38:22.268486 17449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Refusing update from remote peer bfc1dd91ee5347c883ed7273ca5ebd6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 02:38:22.269475 17836 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 02:38:22.270174 17590 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 02:38:22.275439 17590 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 97e0419767324365898711591ae0de53 (127.10.20.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.277071 17648 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 97e0419767324365898711591ae0de53 (127.10.20.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.280375 17837 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.280699 17837 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:22.280970 17837 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.281201 17837 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:22.280838 17449 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 97e0419767324365898711591ae0de53 (127.10.20.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.280368 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.282591 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:22.288389 17840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.288898 17840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:22.289166 17841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:22.289860 17841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:22.355753 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17016
I20260808 02:38:22.379397 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:38647
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:37293
--webserver_port=43609
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:22.814827 17842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:22.815176 17842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:22.815279 17842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:22.823966 17842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:22.824123 17842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:22.824247 17842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:22.835505 17842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:38647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=43609
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:22.837067 17842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:22.838493 17842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:22.856477 17847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:22.856514 17848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:22.856464 17850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:22.861594 17842 server_base.cc:1034] running on GCE node
I20260808 02:38:22.862640 17842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:22.864459 17842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:22.865801 17842 hybrid_clock.cc:648] HybridClock initialized: now 1786156702865731 us; error 59 us; skew 500 ppm
I20260808 02:38:22.866329 17842 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:22.871223 17842 init.cc:377] Logged in from keytab as oryx/127.10.20.66@KRBTEST.COM (short username oryx)
I20260808 02:38:22.873209 17842 webserver.cc:460] Webserver started at http://127.10.20.66:43609/ using document root <none> and password file <none>
I20260808 02:38:22.874064 17842 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:22.874257 17842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:22.881595 17842 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 02:38:22.886389 17859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:22.888669 17842 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:38:22.889043 17842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946"
format_stamp: "Formatted at 2026-08-08 02:38:18 on dist-test-slave-8tdl"
server_key: "7e64cf5bbd5e65a33283967862b36ac2"
server_key_iv: "cac852cde3e5d995f5e329513d9d6705"
server_key_version: "encryptionkey@0"
I20260808 02:38:22.890748 17842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:22.911916 17842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:22.917582 17842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:22.917928 17842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:22.919201 17842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:22.921238 17842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:22.921397 17842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:22.921556 17842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:22.921649 17842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:22.966995 17842 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:38647
I20260808 02:38:22.967149 17978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:38647 every 8 connection(s)
I20260808 02:38:22.968837 17842 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:22.977908 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17842
I20260808 02:38:22.978258 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17155
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.124@KRBTEST.COM
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.67@KRBTEST.COM
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
Aug 08 02:38:22 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156702, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:23.011178 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.973013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:34901 (local address 127.10.20.125:45943)
0808 02:38:22.975514 (+ 2501us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.975525 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.983255 (+ 7730us) server_negotiation.cc:407] Connection header received
0808 02:38:22.983780 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.983787 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.984063 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.984340 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.988027 (+ 3687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.989419 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.993280 (+ 3861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.994126 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.994245 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.001286 (+ 7041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.001292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.001295 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.001334 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.005730 (+ 4396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.007334 (+ 1604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.007342 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.007345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.007561 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.008345 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.008351 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.008353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.008777 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.008932 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.010338 (+ 1406us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.010628 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2204,"thread_start_us":2038,"threads_started":1}
I20260808 02:38:23.011332 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.973188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:49119 (local address 127.10.20.124:44045)
0808 02:38:22.974518 (+ 1330us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.974523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.981581 (+ 7058us) server_negotiation.cc:407] Connection header received
0808 02:38:22.985168 (+ 3587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.985180 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.985523 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.985763 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.988610 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.989797 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.993233 (+ 3436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.993999 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.994131 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.000478 (+ 6347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.000490 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.000498 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.000555 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.006341 (+ 5786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.007650 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.007658 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.007663 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.008237 (+ 574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.008915 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.008922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.008928 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.009412 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.009818 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.010518 (+ 700us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.010872 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1179,"thread_start_us":1063,"threads_started":1}
I20260808 02:38:23.012492 17989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.979459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47674 (local address 127.10.20.67:39419)
0808 02:38:22.982292 (+ 2833us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.982306 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.984479 (+ 2173us) server_negotiation.cc:407] Connection header received
0808 02:38:22.984806 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.984819 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.985153 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.985334 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.988016 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.989719 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.991879 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.992516 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.992669 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.002665 (+ 9996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.002717 (+ 52us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.002740 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.002808 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.007855 (+ 5047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.009063 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.009074 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.009077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.009261 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.010003 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.010008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.010012 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.010485 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.010883 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.011702 (+ 819us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.012038 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2567,"thread_start_us":2369,"threads_started":1}
I20260808 02:38:23.013199 17987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.978795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:33563 (local address 127.10.20.126:37293)
0808 02:38:22.987469 (+ 8674us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:22.987479 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:22.988601 (+ 1122us) server_negotiation.cc:407] Connection header received
0808 02:38:22.988684 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:22.988693 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:22.988796 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:22.988988 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:22.990625 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.991762 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.994764 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.995816 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.995979 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.003683 (+ 7704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.003694 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.003701 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.003761 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.008954 (+ 5193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.010246 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.010252 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.010256 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.010473 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.011054 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.011060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.011064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.011484 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.011660 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.012469 (+ 809us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.012745 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7934,"thread_start_us":7787,"threads_started":1}
I20260808 02:38:23.014178 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.978635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:33563)
0808 02:38:22.987398 (+ 8763us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:22.987445 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:22.987641 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:22.989203 (+ 1562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:22.989209 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:22.989882 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:22.990447 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.990462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.992597 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.992607 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.994490 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.994508 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.996039 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.996046 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.997462 (+ 1416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.998292 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:22.998325 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:23.003351 (+ 5026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:23.009150 (+ 5799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.009156 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.009160 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.009957 (+ 797us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.010638 (+ 681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.010643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.010647 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.010886 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.011740 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:23.011745 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:23.011917 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.012101 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.012999 (+ 898us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8594,"mutex_wait_us":544,"thread_start_us":4013,"threads_started":1}
I20260808 02:38:23.014412 17985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.974249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.10.20.66:49119)
0808 02:38:22.977737 (+ 3488us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:22.977823 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:22.982852 (+ 5029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:22.986268 (+ 3416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:22.986277 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:22.988034 (+ 1757us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:22.988414 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.988430 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.989988 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.989993 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.993022 (+ 3029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.993044 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.994570 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.994580 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.995121 (+ 541us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.996222 (+ 1101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:22.996281 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:23.000104 (+ 3823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:23.006568 (+ 6464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.006575 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.006580 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.007467 (+ 887us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.008499 (+ 1032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.008506 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.008510 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.008744 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.009942 (+ 1198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:23.009948 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:23.010170 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.011623 (+ 1453us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.012425 (+ 802us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2919,"mutex_wait_us":422,"spinlock_wait_cycles":40832,"thread_start_us":2561,"threads_started":1}
I20260808 02:38:23.015570 17282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:23.015266 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:22.974766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.10.20.66:34901)
0808 02:38:22.983057 (+ 8291us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:22.983088 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:22.983427 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:22.985111 (+ 1684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:22.985125 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:22.986528 (+ 1403us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:22.987784 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.987814 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.989673 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.989679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.992996 (+ 3317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:22.993015 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:22.994598 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:22.994608 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:22.995123 (+ 515us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:22.996264 (+ 1141us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:22.996308 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:23.000918 (+ 4610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:23.006007 (+ 5089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.006020 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.006045 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.007143 (+ 1098us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.007755 (+ 612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.007760 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.007764 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.008191 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.009054 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:23.009063 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:23.009751 (+ 688us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.011895 (+ 2144us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.012630 (+ 735us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8101,"mutex_wait_us":504,"spinlock_wait_cycles":10624,"thread_start_us":12202,"threads_started":1}
I20260808 02:38:23.016908 17979 heartbeater.cc:347] Connected to a master server at 127.10.20.124:44045
I20260808 02:38:23.017278 17980 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37293
I20260808 02:38:23.017439 17981 heartbeater.cc:347] Connected to a master server at 127.10.20.125:45943
I20260808 02:38:23.017616 17981 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:23.017710 17979 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:23.017620 17980 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:23.019145 17979 heartbeater.cc:511] Master 127.10.20.124:44045 requested a full tablet report, sending...
I20260808 02:38:23.019354 17980 heartbeater.cc:511] Master 127.10.20.126:37293 requested a full tablet report, sending...
I20260808 02:38:23.019631 17981 heartbeater.cc:511] Master 127.10.20.125:45943 requested a full tablet report, sending...
I20260808 02:38:23.021235 16814 ts_manager.cc:194] Re-registered known tserver with Master: 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647)
I20260808 02:38:23.021418 17637 ts_manager.cc:194] Registered new tserver with Master: 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647)
I20260808 02:38:23.021896 17439 ts_manager.cc:194] Registered new tserver with Master: 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647)
I20260808 02:38:23.022879 16814 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:33563
I20260808 02:38:23.114473 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17155
I20260808 02:38:23.136344 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:39419
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:37293
--webserver_port=42805
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:23.268172 17823 heartbeater.cc:503] Master 127.10.20.126:37293 was elected leader, sending a full tablet report...
W20260808 02:38:23.549052 17992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:23.549372 17992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:23.549544 17992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:23.557739 17992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:23.557893 17992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:23.558133 17992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:23.569921 17992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:39419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=42805
--tserver_master_addrs=127.10.20.126:37293,127.10.20.125:45943,127.10.20.124:44045
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:23.571682 17992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:23.573416 17992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:23.591437 17998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:23.592703 17997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:23.593060 18000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:23.593941 17992 server_base.cc:1034] running on GCE node
I20260808 02:38:23.595085 17992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:23.596589 17992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:23.598007 17992 hybrid_clock.cc:648] HybridClock initialized: now 1786156703597919 us; error 46 us; skew 500 ppm
I20260808 02:38:23.598452 17992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:23 dist-test-slave-8tdl krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156703, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:23.602545 17992 init.cc:377] Logged in from keytab as oryx/127.10.20.67@KRBTEST.COM (short username oryx)
I20260808 02:38:23.604624 17992 webserver.cc:460] Webserver started at http://127.10.20.67:42805/ using document root <none> and password file <none>
I20260808 02:38:23.605551 17992 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:23.605819 17992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:23.613724 17992 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 02:38:23.617447 18008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:23.619470 17992 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:38:23.619721 17992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "86752ca679164d1eb466ea3b00b02dcb"
format_stamp: "Formatted at 2026-08-08 02:38:19 on dist-test-slave-8tdl"
server_key: "8dae3a9aa47a15efecfddcea09db02e4"
server_key_iv: "84c88f542d7cae6b5738043fe8930822"
server_key_version: "encryptionkey@0"
I20260808 02:38:23.620987 17992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:23.637239 17992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:23.643535 17992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:23.643893 17992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:23.645074 17992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:23.647018 17992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:23.647182 17992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:23.647339 17992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:23.647444 17992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:23.697182 17992 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:39419
I20260808 02:38:23.697532 18123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:39419 every 8 connection(s)
I20260808 02:38:23.698983 17992 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:23.705963 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 17992
Aug 08 02:38:23 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156703, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.125@KRBTEST.COM
Aug 08 02:38:23 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156703, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.124@KRBTEST.COM
Aug 08 02:38:23 dist-test-slave-8tdl krb5kdc[16767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156703, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:23.751127 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.702869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44973 (local address 127.10.20.124:44045)
0808 02:38:23.703541 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.703548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.704968 (+ 1420us) server_negotiation.cc:407] Connection header received
0808 02:38:23.709270 (+ 4302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.709281 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.709424 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.709664 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:23.713595 (+ 3931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.715025 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.722063 (+ 7038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.723173 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.723413 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.738229 (+ 14816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.738243 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.738253 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.738325 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.744000 (+ 5675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.745664 (+ 1664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.745673 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.745680 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.745938 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.746788 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.746796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.746802 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.747380 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.747607 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.750044 (+ 2437us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.750421 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":383,"threads_started":1}
I20260808 02:38:23.752573 18132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.703676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.10.20.67:46677)
0808 02:38:23.704749 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:23.704814 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:23.712144 (+ 7330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:23.717564 (+ 5420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:23.717573 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:23.718920 (+ 1347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:23.719383 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.719402 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.721498 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.721503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.723195 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.723213 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.726554 (+ 3341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.726564 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.727059 (+ 495us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.728064 (+ 1005us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:23.728106 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:23.736520 (+ 8414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:23.747555 (+ 11035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.747562 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.747567 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.748255 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.748863 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.748871 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.748875 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.749082 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.749903 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:23.749912 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:23.750113 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.750280 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.750597 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":50,"spinlock_wait_cycles":112640,"thread_start_us":519,"threads_started":1}
I20260808 02:38:23.755039 18133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.704417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:46677 (local address 127.10.20.125:45943)
0808 02:38:23.717107 (+ 12690us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.717113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.717139 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:38:23.717217 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.717222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.717316 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.717466 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:23.719700 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.721168 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.723960 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.726212 (+ 2252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.726400 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.736871 (+ 10471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.736880 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.736887 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.736960 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.743448 (+ 6488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.748474 (+ 5026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.748481 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.748485 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.748706 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.749262 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.749268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.749271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.749731 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.753993 (+ 4262us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.754159 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.754492 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12534,"thread_start_us":12356,"threads_started":1}
I20260808 02:38:23.756135 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.703675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.10.20.67:44973)
0808 02:38:23.704747 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:23.704813 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:23.708626 (+ 3813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:23.710631 (+ 2005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:23.710650 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:23.711915 (+ 1265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:23.713206 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.713246 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.715403 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.715412 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.718776 (+ 3364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.718805 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.724272 (+ 5467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.724280 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.724714 (+ 434us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.726002 (+ 1288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:23.726209 (+ 207us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:23.736332 (+ 10123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:23.744302 (+ 7970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.744320 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.744353 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.745356 (+ 1003us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.746127 (+ 771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.746136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.746143 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.746568 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.747736 (+ 1168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:23.747750 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:23.748574 (+ 824us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.749042 (+ 468us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.750345 (+ 1303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":851,"threads_started":1}
I20260808 02:38:23.756758 18135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.706345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:48285)
0808 02:38:23.721377 (+ 15032us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:23.721401 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:23.721546 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:23.726841 (+ 5295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:23.726849 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:23.727646 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:23.728145 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.728160 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.729972 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.729978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.732053 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.732076 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.734573 (+ 2497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.734586 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.734991 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.736214 (+ 1223us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:23.736276 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:23.742196 (+ 5920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:23.749437 (+ 7241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.749442 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.749445 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.750112 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.753884 (+ 3772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:23.753890 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:23.753894 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:23.754138 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:23.755447 (+ 1309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:23.755453 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:23.755704 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.755883 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.756287 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14864,"spinlock_wait_cycles":5888,"thread_start_us":15315,"threads_started":1}
I20260808 02:38:23.757051 18127 heartbeater.cc:347] Connected to a master server at 127.10.20.125:45943
I20260808 02:38:23.757118 18124 heartbeater.cc:347] Connected to a master server at 127.10.20.124:44045
I20260808 02:38:23.757368 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.706250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:48285 (local address 127.10.20.126:37293)
0808 02:38:23.720257 (+ 14007us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.720266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.723377 (+ 3111us) server_negotiation.cc:407] Connection header received
0808 02:38:23.723463 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.723471 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.723589 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.723706 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:23.728449 (+ 4743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.729734 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.732320 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.733113 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.734119 (+ 1006us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.742617 (+ 8498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.742627 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.742634 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.742714 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.747259 (+ 4545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.753475 (+ 6216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.753484 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.753489 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.753741 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.754781 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.754788 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.754791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.755285 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.755475 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.756625 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.756936 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13820,"thread_start_us":15045,"threads_started":1}
I20260808 02:38:23.757429 18124 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:23.757436 18127 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:23.758586 18124 heartbeater.cc:511] Master 127.10.20.124:44045 requested a full tablet report, sending...
I20260808 02:38:23.759171 18126 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37293
I20260808 02:38:23.759493 18126 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:23.759776 18127 heartbeater.cc:511] Master 127.10.20.125:45943 requested a full tablet report, sending...
I20260808 02:38:23.760401 18126 heartbeater.cc:511] Master 127.10.20.126:37293 requested a full tablet report, sending...
I20260808 02:38:23.761600 17439 ts_manager.cc:194] Registered new tserver with Master: 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67:39419)
I20260808 02:38:23.761744 17637 ts_manager.cc:194] Registered new tserver with Master: 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67:39419)
I20260808 02:38:23.762351 16814 ts_manager.cc:194] Re-registered known tserver with Master: 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67:39419)
I20260808 02:38:23.763691 16814 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:48285
I20260808 02:38:23.769819 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.733425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59728 (local address 127.10.20.125:45943)
0808 02:38:23.734165 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.734174 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.734898 (+ 724us) server_negotiation.cc:407] Connection header received
0808 02:38:23.735279 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.735285 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.735374 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.735939 (+ 565us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:23.745316 (+ 9377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.746907 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.750909 (+ 4002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.751738 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.751853 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.761777 (+ 9924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.761784 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.761788 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.761831 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.765724 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.767260 (+ 1536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.767267 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.767271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.767460 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.767896 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.767909 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.767913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.768330 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.768608 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.769057 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.769335 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":331,"threads_started":1}
I20260808 02:38:23.781870 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.753809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52900 (local address 127.10.20.124:44045)
0808 02:38:23.754173 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.754181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.754986 (+ 805us) server_negotiation.cc:407] Connection header received
0808 02:38:23.755268 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.755274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.755410 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.755482 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:23.764384 (+ 8902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.765630 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.768020 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.768741 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.768894 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.773329 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.773336 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.773339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.773383 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.777578 (+ 4195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.778998 (+ 1420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.779005 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.779009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.779240 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.779777 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.779780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.779783 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.780225 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.780555 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.781076 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.781360 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235}
I20260808 02:38:23.782840 18143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.733623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40356 (local address 127.10.20.126:37293)
0808 02:38:23.740626 (+ 7003us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.740634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.753701 (+ 13067us) server_negotiation.cc:407] Connection header received
0808 02:38:23.757470 (+ 3769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.757476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.757585 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.757694 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:23.763123 (+ 5429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.766582 (+ 3459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.768710 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.769452 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.769599 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.774229 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:23.774235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:23.774239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:23.774281 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:23.779098 (+ 4817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.780203 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.780210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.780213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.780394 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:23.780921 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:23.780928 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:23.780931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:23.781353 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:23.781662 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.781951 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.782333 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":6781,"thread_start_us":7034,"threads_started":1}
I20260808 02:38:23.789738 16814 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:23.798552 16814 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:23.839581 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.827238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:38647 (local address 127.0.0.1:49956)
0808 02:38:23.831209 (+ 3971us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:23.831232 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:23.831445 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:23.832561 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:23.832564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:23.832588 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:23.832883 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.832890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.834266 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.834271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.836554 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.836566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.838631 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.838637 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.838864 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.838909 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.839029 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.839186 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3847,"thread_start_us":3675,"threads_started":1}
I20260808 02:38:23.839574 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.827541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.10.20.66:38647)
0808 02:38:23.828308 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.828318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.831390 (+ 3072us) server_negotiation.cc:407] Connection header received
0808 02:38:23.831712 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.831722 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.832079 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.832296 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:23.833060 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.834088 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.836717 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.838435 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.838579 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.838846 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.839095 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.839274 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":457,"threads_started":1}
I20260808 02:38:23.845304 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.828599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.10.20.67:39419)
0808 02:38:23.829407 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.829414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.835752 (+ 6338us) server_negotiation.cc:407] Connection header received
0808 02:38:23.836565 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.836579 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.836984 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.837226 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:23.837905 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.840132 (+ 2227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.842496 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.844111 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.844262 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.844485 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.844753 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.844941 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":451,"threads_started":1}
I20260808 02:38:23.845778 18159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.827614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:39419 (local address 127.0.0.1:47690)
0808 02:38:23.835303 (+ 7689us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:23.835574 (+ 271us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:23.836242 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:23.837220 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:23.837226 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:23.837254 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:23.837669 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.837682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.840257 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.840263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.842289 (+ 2026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.842306 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.844320 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.844327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.844531 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.844573 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.844686 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.844841 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7513,"thread_start_us":7349,"threads_started":1}
I20260808 02:38:23.845546 17911 tablet_service.cc:1467] Processing CreateTablet for tablet a20ea08e5380489da241967fc5d6be6e (DEFAULT_TABLE table=test-table [id=0fa727d475d648089b50c383d32ec138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:23.847259 17911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20ea08e5380489da241967fc5d6be6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:23.847869 18162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.835790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36802 (local address 127.10.20.65:43557)
0808 02:38:23.837113 (+ 1323us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:23.837123 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:23.838433 (+ 1310us) server_negotiation.cc:407] Connection header received
0808 02:38:23.838592 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:23.838600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:23.838916 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:23.839148 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:23.840027 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.841603 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.843746 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.845169 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.845303 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.845528 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:23.846211 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 02:38:23.846449 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1137,"thread_start_us":1014,"threads_started":1}
I20260808 02:38:23.848855 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:23.835453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43557 (local address 127.0.0.1:36802)
0808 02:38:23.838272 (+ 2819us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:23.838298 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:23.838437 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:23.839363 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:23.839368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:23.839394 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:23.839800 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.839812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.841767 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.841775 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.843563 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:23.843579 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:23.845704 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:23.845710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:23.845947 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:23.845990 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:38:23.848285 (+ 2295us) client_negotiation.cc:240] Negotiation successful
0808 02:38:23.848484 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2692,"thread_start_us":929,"threads_started":1}
I20260808 02:38:23.850596 18057 tablet_service.cc:1467] Processing CreateTablet for tablet a20ea08e5380489da241967fc5d6be6e (DEFAULT_TABLE table=test-table [id=0fa727d475d648089b50c383d32ec138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:23.852696 18057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20ea08e5380489da241967fc5d6be6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:23.854190 17756 tablet_service.cc:1467] Processing CreateTablet for tablet a20ea08e5380489da241967fc5d6be6e (DEFAULT_TABLE table=test-table [id=0fa727d475d648089b50c383d32ec138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:23.856351 17756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a20ea08e5380489da241967fc5d6be6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:23.863373 18164 tablet_bootstrap.cc:492] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Bootstrap starting.
I20260808 02:38:23.867254 18164 tablet_bootstrap.cc:654] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:23.868587 18164 log.cc:824] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:23.872990 18164 tablet_bootstrap.cc:492] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: No bootstrap required, opened a new log
I20260808 02:38:23.873392 18164 ts_tablet_manager.cc:1397] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 02:38:23.875851 18166 tablet_bootstrap.cc:492] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Bootstrap starting.
I20260808 02:38:23.879678 18167 tablet_bootstrap.cc:492] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Bootstrap starting.
I20260808 02:38:23.881934 18166 tablet_bootstrap.cc:654] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:23.883900 18166 log.cc:824] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:23.884039 18167 tablet_bootstrap.cc:654] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:23.885758 18167 log.cc:824] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:23.886312 18164 raft_consensus.cc:348] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:23.886919 18164 raft_consensus.cc:374] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:23.887058 18164 raft_consensus.cc:729] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af1bac4b7114a8dbb92fdb2aa3c9946, State: Initialized, Role: FOLLOWER
I20260808 02:38:23.887902 18164 consensus_queue.cc:260] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:23.888491 18166 tablet_bootstrap.cc:492] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: No bootstrap required, opened a new log
I20260808 02:38:23.888913 18166 ts_tablet_manager.cc:1397] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260808 02:38:23.889570 17980 heartbeater.cc:503] Master 127.10.20.126:37293 was elected leader, sending a full tablet report...
I20260808 02:38:23.890044 18167 tablet_bootstrap.cc:492] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: No bootstrap required, opened a new log
I20260808 02:38:23.890373 18167 ts_tablet_manager.cc:1397] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 02:38:23.900566 18164 ts_tablet_manager.cc:1428] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Time spent starting tablet: real 0.027s user 0.019s sys 0.000s
I20260808 02:38:23.903694 18166 raft_consensus.cc:348] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:23.904245 18166 raft_consensus.cc:374] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:23.904393 18166 raft_consensus.cc:729] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86752ca679164d1eb466ea3b00b02dcb, State: Initialized, Role: FOLLOWER
I20260808 02:38:23.905244 18166 consensus_queue.cc:260] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:23.906626 18126 heartbeater.cc:503] Master 127.10.20.126:37293 was elected leader, sending a full tablet report...
I20260808 02:38:23.906330 18167 raft_consensus.cc:348] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:23.906939 18167 raft_consensus.cc:374] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:23.907058 18167 raft_consensus.cc:729] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c7a157d8aa4525969ccdfc569f15ca, State: Initialized, Role: FOLLOWER
I20260808 02:38:23.907773 18167 consensus_queue.cc:260] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:23.910306 18167 ts_tablet_manager.cc:1428] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Time spent starting tablet: real 0.020s user 0.012s sys 0.004s
I20260808 02:38:23.914075 18166 ts_tablet_manager.cc:1428] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Time spent starting tablet: real 0.025s user 0.014s sys 0.005s
W20260808 02:38:23.930281 17825 tablet.cc:2369] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:38:23.953727 18128 tablet.cc:2369] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:38:23.981166 17982 tablet.cc:2369] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:38:24.019011 18171 raft_consensus.cc:482] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:24.019496 18171 raft_consensus.cc:504] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:24.021478 18171 leader_election.cc:288] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647), f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557)
I20260808 02:38:24.030951 18162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.022084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:39211 (local address 127.10.20.65:43557)
0808 02:38:24.022273 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.022281 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.022337 (+ 56us) server_negotiation.cc:407] Connection header received
0808 02:38:24.022562 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.022566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.022628 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.023196 (+ 568us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:24.023589 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.024798 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.027711 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.029291 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.029528 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.029616 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.030463 (+ 847us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.030626 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:38:24.031051 18135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.021944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43557 (local address 127.10.20.67:39211)
0808 02:38:24.022239 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:24.022278 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:24.022417 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:24.023228 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:24.023232 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:24.023261 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:24.023455 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:24.023468 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.024958 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.024964 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:24.027448 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:24.027471 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.029618 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.029626 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:24.030112 (+ 486us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.030218 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 02:38:24.030356 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 02:38:24.030627 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":566,"spinlock_wait_cycles":2688}
I20260808 02:38:24.031006 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.022017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:36823 (local address 127.10.20.66:38647)
0808 02:38:24.022245 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.022252 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.022378 (+ 126us) server_negotiation.cc:407] Connection header received
0808 02:38:24.022830 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.022834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.022896 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.023035 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:24.023581 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.024765 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.027704 (+ 2939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.029302 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.029526 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.029616 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.030463 (+ 847us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.030626 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:38:24.031596 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.021882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:38647 (local address 127.10.20.67:36823)
0808 02:38:24.022239 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:24.022260 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:24.022417 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:24.023058 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:24.023066 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:24.023102 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:24.023361 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:24.023378 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.024957 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.024964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:24.027448 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:24.027471 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.029618 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.029626 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:24.030112 (+ 486us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.030218 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 02:38:24.030356 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 02:38:24.030627 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":179,"spinlock_wait_cycles":6528}
I20260808 02:38:24.032277 17776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20ea08e5380489da241967fc5d6be6e" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" is_pre_election: true
I20260808 02:38:24.032944 17776 raft_consensus.cc:2454] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 0.
I20260808 02:38:24.032859 17932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20ea08e5380489da241967fc5d6be6e" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" is_pre_election: true
I20260808 02:38:24.033401 17932 raft_consensus.cc:2454] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 0.
I20260808 02:38:24.033900 18009 leader_election.cc:302] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86752ca679164d1eb466ea3b00b02dcb, f8c7a157d8aa4525969ccdfc569f15ca; no voters:
I20260808 02:38:24.034487 18171 raft_consensus.cc:2781] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:24.034667 18171 raft_consensus.cc:482] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:24.034837 18171 raft_consensus.cc:3037] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:24.037341 18171 raft_consensus.cc:504] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:24.038064 18171 leader_election.cc:288] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 election: Requested vote from peers 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647), f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557)
I20260808 02:38:24.038731 17932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20ea08e5380489da241967fc5d6be6e" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946"
I20260808 02:38:24.038825 17776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a20ea08e5380489da241967fc5d6be6e" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c7a157d8aa4525969ccdfc569f15ca"
I20260808 02:38:24.038993 17932 raft_consensus.cc:3037] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:24.039110 17776 raft_consensus.cc:3037] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:24.041774 17776 raft_consensus.cc:2454] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 1.
I20260808 02:38:24.041800 17932 raft_consensus.cc:2454] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 1.
I20260808 02:38:24.042371 18009 leader_election.cc:302] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86752ca679164d1eb466ea3b00b02dcb, f8c7a157d8aa4525969ccdfc569f15ca; no voters:
I20260808 02:38:24.042817 18171 raft_consensus.cc:2781] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:24.043368 18171 raft_consensus.cc:686] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 1 LEADER]: Becoming Leader. State: Replica: 86752ca679164d1eb466ea3b00b02dcb, State: Running, Role: LEADER
I20260808 02:38:24.044013 18171 consensus_queue.cc:237] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } }
I20260808 02:38:24.050796 16813 catalog_manager.cc:5495] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb reported cstate change: term changed from 0 to 1, leader changed from <none> to 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67). New cstate: current_term: 1 leader_uuid: "86752ca679164d1eb466ea3b00b02dcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } health_report { overall_health: UNKNOWN } } }
I20260808 02:38:24.088128 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.081600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.10.20.67:39419)
0808 02:38:24.081871 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.081876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.081895 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:38:24.082101 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.082105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.082195 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.082384 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:24.082840 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.083880 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.085316 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.085806 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.085986 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.086737 (+ 751us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:24.087312 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:24.087435 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.087613 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.087707 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 02:38:24.097716 17932 raft_consensus.cc:1261] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Refusing update from remote peer 86752ca679164d1eb466ea3b00b02dcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:24.097714 17776 raft_consensus.cc:1261] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Refusing update from remote peer 86752ca679164d1eb466ea3b00b02dcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:24.098893 18171 consensus_queue.cc:1035] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:24.099233 18173 consensus_queue.cc:1035] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:24.116241 18178 mvcc.cc:205] Tried to move back new op lower bound from 7316097859972169728 to 7316097859769339904. Current Snapshot: MvccSnapshot[applied={T|T < 7316097859972169728}]
I20260808 02:38:24.135646 16813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:24.136055 16813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:24.144670 16813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bfc1dd91ee5347c883ed7273ca5ebd6a: Sending DeleteTablet for 3 replicas of tablet a20ea08e5380489da241967fc5d6be6e
I20260808 02:38:24.145979 17911 tablet_service.cc:1514] Processing DeleteTablet for tablet a20ea08e5380489da241967fc5d6be6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:24 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:49956
I20260808 02:38:24.146180 17756 tablet_service.cc:1514] Processing DeleteTablet for tablet a20ea08e5380489da241967fc5d6be6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:24 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:36802
I20260808 02:38:24.147610 18057 tablet_service.cc:1514] Processing DeleteTablet for tablet a20ea08e5380489da241967fc5d6be6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:24 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:47690
I20260808 02:38:24.159750 18189 tablet_replica.cc:330] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: stopping tablet replica
I20260808 02:38:24.160694 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 16782
I20260808 02:38:24.162163 16844 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:24.167537 18189 raft_consensus.cc:2229] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:24.168339 18189 raft_consensus.cc:2258] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:24.168952 18186 tablet_replica.cc:330] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: stopping tablet replica
I20260808 02:38:24.169445 18186 raft_consensus.cc:2229] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:24.170007 18186 raft_consensus.cc:2258] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:24.172713 18186 ts_tablet_manager.cc:1905] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:24.174562 18189 ts_tablet_manager.cc:1905] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:24.177709 18187 tablet_replica.cc:330] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: stopping tablet replica
I20260808 02:38:24.178239 18187 raft_consensus.cc:2229] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:24.178848 18187 raft_consensus.cc:2258] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:24.186149 18186 ts_tablet_manager.cc:1918] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:24.186374 18186 log.cc:1196] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/a20ea08e5380489da241967fc5d6be6e
I20260808 02:38:24.187042 18186 ts_tablet_manager.cc:1939] T a20ea08e5380489da241967fc5d6be6e P 9af1bac4b7114a8dbb92fdb2aa3c9946: Deleting consensus metadata
I20260808 02:38:24.190382 18187 ts_tablet_manager.cc:1905] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:24.198534 18187 ts_tablet_manager.cc:1918] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:24.198787 18187 log.cc:1196] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/a20ea08e5380489da241967fc5d6be6e
I20260808 02:38:24.199529 18187 ts_tablet_manager.cc:1939] T a20ea08e5380489da241967fc5d6be6e P f8c7a157d8aa4525969ccdfc569f15ca: Deleting consensus metadata
I20260808 02:38:24.200680 18189 ts_tablet_manager.cc:1918] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:24.200887 18189 log.cc:1196] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/a20ea08e5380489da241967fc5d6be6e
I20260808 02:38:24.201527 18189 ts_tablet_manager.cc:1939] T a20ea08e5380489da241967fc5d6be6e P 86752ca679164d1eb466ea3b00b02dcb: Deleting consensus metadata
I20260808 02:38:24.206996 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.148450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59734 (local address 127.10.20.125:45943)
0808 02:38:24.148659 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.148668 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.158836 (+ 10168us) server_negotiation.cc:407] Connection header received
0808 02:38:24.159094 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.159101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.159212 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.159332 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:24.177155 (+ 17823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.178332 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.181124 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.181833 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.181992 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.188339 (+ 6347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:24.188347 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:24.188353 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:24.188420 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:24.192493 (+ 4073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.203606 (+ 11113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.203615 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.203619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.203846 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.204531 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.204536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.204540 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.204985 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:24.205300 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.205979 (+ 679us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.206255 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:38:24.227995 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.159176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52908 (local address 127.10.20.124:44045)
0808 02:38:24.159408 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.159414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.206877 (+ 47463us) server_negotiation.cc:407] Connection header received
0808 02:38:24.207167 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.207173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.207295 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.207375 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:24.209713 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.211403 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.213850 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.214846 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.214987 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.219634 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:24.219643 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:24.219649 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:24.219707 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:24.223941 (+ 4234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.225307 (+ 1366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.225314 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.225318 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.225519 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.226101 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.226107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.226111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.226596 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:24.226944 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.227294 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.227590 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:38:24.337069 16801 catalog_manager.cc:4841] TS 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647): tablet a20ea08e5380489da241967fc5d6be6e (table test-table [id=0fa727d475d648089b50c383d32ec138]) successfully deleted
I20260808 02:38:24.337759 16798 catalog_manager.cc:4841] TS 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67:39419): tablet a20ea08e5380489da241967fc5d6be6e (table test-table [id=0fa727d475d648089b50c383d32ec138]) successfully deleted
I20260808 02:38:24.338271 16798 catalog_manager.cc:4841] TS f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557): tablet a20ea08e5380489da241967fc5d6be6e (table test-table [id=0fa727d475d648089b50c383d32ec138]) successfully deleted
I20260808 02:38:24.338945 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 16782
I20260808 02:38:24.391325 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.369670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54126 (local address 127.10.20.124:44045)
0808 02:38:24.369972 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.369981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.371172 (+ 1191us) server_negotiation.cc:407] Connection header received
0808 02:38:24.371250 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.371256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.371385 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.371486 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:24.375024 (+ 3538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.376875 (+ 1851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.379349 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.380083 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.380214 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.384060 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:24.384070 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:24.384076 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:24.384131 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:24.387471 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.388380 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.388386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.388389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.388575 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.389033 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.389037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.389039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.389460 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:24.389718 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.390888 (+ 1170us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.391082 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:38:24.391887 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:24.368541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38108 (local address 127.10.20.125:45943)
0808 02:38:24.368824 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:24.368847 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:24.370737 (+ 1890us) server_negotiation.cc:407] Connection header received
0808 02:38:24.371139 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:24.371149 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:24.371267 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:24.371361 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:24.375231 (+ 3870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.376361 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.378998 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:24.379593 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:24.379754 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:24.383975 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:24.383982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:24.383988 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:24.384049 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:24.388132 (+ 4083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.388984 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.388989 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.388993 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.389179 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:24.389608 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:24.389613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:24.389617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:24.389988 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:24.390375 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:24.390761 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 02:38:24.391054 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 02:38:25.129192 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.127919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:47405)
0808 02:38:25.128484 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.128685 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":326,"threads_started":1}
I20260808 02:38:25.129383 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.127888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:53917)
0808 02:38:25.128924 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.129100 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":901,"thread_start_us":759,"threads_started":1}
W20260808 02:38:25.130271 17980 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:37293 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
W20260808 02:38:25.130475 18126 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:37293 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
I20260808 02:38:25.138655 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.137522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:35613)
0808 02:38:25.138074 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.138248 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":309,"threads_started":1}
W20260808 02:38:25.139408 17823 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:37293 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
I20260808 02:38:25.643438 18202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bfc1dd91ee5347c883ed7273ca5ebd6a)
I20260808 02:38:25.643762 18202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } }
I20260808 02:38:25.644083 18203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bfc1dd91ee5347c883ed7273ca5ebd6a)
I20260808 02:38:25.644307 18203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } }
I20260808 02:38:25.645043 18202 leader_election.cc:288] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293), 97e0419767324365898711591ae0de53 (127.10.20.124:44045)
I20260808 02:38:25.645190 18203 leader_election.cc:288] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293), 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125:45943)
I20260808 02:38:25.646473 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.645282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55756)
0808 02:38:25.645861 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.646118 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":479,"threads_started":1}
I20260808 02:38:25.646893 18204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.645116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55754)
0808 02:38:25.646245 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.646522 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":798,"threads_started":1}
W20260808 02:38:25.647096 17624 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
W20260808 02:38:25.651676 17425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
I20260808 02:38:25.661775 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.660529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55774)
0808 02:38:25.661080 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.661388 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337}
W20260808 02:38:25.662092 17624 leader_election.cc:334] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293): Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
I20260808 02:38:25.664335 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.645675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:45943 (local address 127.0.0.1:38124)
0808 02:38:25.647030 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.647052 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:25.647216 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:25.652852 (+ 5636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:25.652862 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:25.652925 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:25.653333 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.653354 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.656196 (+ 2842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.656208 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.660056 (+ 3848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.660094 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.662964 (+ 2870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.662977 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.663358 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.663432 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 02:38:25.663571 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 02:38:25.663780 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1251,"mutex_wait_us":973,"thread_start_us":4908,"threads_started":1}
I20260808 02:38:25.665511 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.645609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38124 (local address 127.10.20.125:45943)
0808 02:38:25.652287 (+ 6678us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:25.652296 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:25.652337 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:38:25.652439 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:25.652448 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:25.652579 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:25.653570 (+ 991us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:25.653996 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.655849 (+ 1853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.660505 (+ 4656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.662535 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.664676 (+ 2141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.664799 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:25.664878 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 02:38:25.665057 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6543,"thread_start_us":6330,"threads_started":1}
I20260808 02:38:25.665838 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.665033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55780)
0808 02:38:25.665288 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.665536 (+ 248us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260808 02:38:25.666051 17425 leader_election.cc:334] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293): Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
I20260808 02:38:25.666435 17449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97e0419767324365898711591ae0de53" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" is_pre_election: true
I20260808 02:38:25.666800 17449 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97e0419767324365898711591ae0de53 in term 1.
I20260808 02:38:25.667410 17622 leader_election.cc:302] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7e6ad9bef746f2ae05af9c844c0def, 97e0419767324365898711591ae0de53; no voters: bfc1dd91ee5347c883ed7273ca5ebd6a
I20260808 02:38:25.667901 18203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 02:38:25.668092 18203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bfc1dd91ee5347c883ed7273ca5ebd6a)
I20260808 02:38:25.668231 18203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:38:25.671020 18203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } }
I20260808 02:38:25.671377 18204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.646375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:44045 (local address 127.0.0.1:54138)
0808 02:38:25.647394 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.649787 (+ 2393us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:25.649966 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:25.663608 (+ 13642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:25.663614 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:25.663658 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:25.663983 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.663998 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.666844 (+ 2846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.666849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.668738 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.668757 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.670338 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.670347 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.670566 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.670596 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 02:38:25.670762 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 02:38:25.670966 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":4874,"threads_started":1}
I20260808 02:38:25.671478 18210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.652039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54138 (local address 127.10.20.124:44045)
0808 02:38:25.663166 (+ 11127us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:25.663172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:25.663200 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:38:25.663282 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:25.663289 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:25.663403 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:25.663553 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:25.664878 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.666632 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.668972 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.670075 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.670275 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.670424 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:25.670791 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 02:38:25.670965 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10951,"thread_start_us":11028,"threads_started":1}
I20260808 02:38:25.671921 18203 leader_election.cc:288] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 2 election: Requested vote from peers bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293), 2a7e6ad9bef746f2ae05af9c844c0def (127.10.20.125:45943)
I20260808 02:38:25.672291 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "97e0419767324365898711591ae0de53" is_pre_election: true
I20260808 02:38:25.672588 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.672053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55794)
0808 02:38:25.672273 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.672374 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 02:38:25.672662 17449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97e0419767324365898711591ae0de53" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2a7e6ad9bef746f2ae05af9c844c0def"
I20260808 02:38:25.672933 17648 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a7e6ad9bef746f2ae05af9c844c0def in current term 2: Already voted for candidate 97e0419767324365898711591ae0de53 in this term.
I20260808 02:38:25.672915 17449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:38:25.673580 17425 leader_election.cc:302] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a7e6ad9bef746f2ae05af9c844c0def; no voters: 97e0419767324365898711591ae0de53, bfc1dd91ee5347c883ed7273ca5ebd6a
I20260808 02:38:25.673933 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.673413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55800)
0808 02:38:25.673669 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.673770 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
W20260808 02:38:25.674147 17624 leader_election.cc:334] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293): Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
I20260808 02:38:25.675935 17449 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97e0419767324365898711591ae0de53 in term 2.
I20260808 02:38:25.676290 18202 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 02:38:25.676576 17622 leader_election.cc:302] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7e6ad9bef746f2ae05af9c844c0def, 97e0419767324365898711591ae0de53; no voters: bfc1dd91ee5347c883ed7273ca5ebd6a
I20260808 02:38:25.676995 18203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:38:25.677678 18203 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [term 2 LEADER]: Becoming Leader. State: Replica: 97e0419767324365898711591ae0de53, State: Running, Role: LEADER
I20260808 02:38:25.678186 18203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } }
I20260808 02:38:25.680652 18212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97e0419767324365898711591ae0de53. Latest consensus state: current_term: 2 leader_uuid: "97e0419767324365898711591ae0de53" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:25.681053 18212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:25.681778 18214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:25.685832 18214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:25.686931 18214 catalog_manager.cc:1259] Loaded cluster ID: 51db911a4a304f47bc1838575f906413
I20260808 02:38:25.687029 18214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:25.688397 18214 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:25.689334 18214 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Loaded TSK: 0
I20260808 02:38:25.690322 18214 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:38:25.726070 17637 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:25.737424 17637 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:25.742800 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.742174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55812)
0808 02:38:25.742443 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.742557 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 02:38:25.742908 17449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [term 2 FOLLOWER]: Refusing update from remote peer 97e0419767324365898711591ae0de53: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 02:38:25.743999 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.743531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55814)
0808 02:38:25.743729 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.743845 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 02:38:25.743959 18212 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 02:38:25.744417 17624 consensus_peers.cc:487] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 -> Peer bfc1dd91ee5347c883ed7273ca5ebd6a (127.10.20.126:37293): Couldn't send request to peer bfc1dd91ee5347c883ed7273ca5ebd6a. Status: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 02:38:25.747622 18202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97e0419767324365898711591ae0de53. Latest consensus state: current_term: 2 leader_uuid: "97e0419767324365898711591ae0de53" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:25.747974 18202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:25.750166 18212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "97e0419767324365898711591ae0de53" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:25.750533 18212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53 [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:25.751688 18202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "97e0419767324365898711591ae0de53" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "bfc1dd91ee5347c883ed7273ca5ebd6a" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37293 } } peers { permanent_uuid: "2a7e6ad9bef746f2ae05af9c844c0def" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 45943 } attrs { promote: false } } peers { permanent_uuid: "97e0419767324365898711591ae0de53" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 44045 } attrs { promote: false } } }
I20260808 02:38:25.752002 18202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a7e6ad9bef746f2ae05af9c844c0def [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:38:25.772469 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.761309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:39419 (local address 127.0.0.1:60872)
0808 02:38:25.761457 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.761476 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:25.761580 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:25.762372 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:25.762381 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:25.762423 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:25.763016 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.763039 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.765113 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.765124 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.768557 (+ 3433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.768599 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.771337 (+ 2738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.771347 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.771595 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.771654 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 02:38:25.771768 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 02:38:25.771972 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 02:38:25.773538 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.761436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60872 (local address 127.10.20.67:39419)
0808 02:38:25.761966 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:25.761973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:25.761994 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:38:25.762086 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:25.762092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:25.762185 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:25.762315 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:25.763269 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.764831 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.768946 (+ 4115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.770913 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.771201 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.771463 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:25.772988 (+ 1525us) server_negotiation.cc:299] Negotiation successful
0808 02:38:25.773202 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":304,"threads_started":1}
I20260808 02:38:25.774498 18057 tablet_service.cc:1467] Processing CreateTablet for tablet 36ee8d3358de4354ad43edb970f7a1fa (DEFAULT_TABLE table=test-table [id=42cbe4d27a304c11a60ab2cd364879bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:25.775072 18057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36ee8d3358de4354ad43edb970f7a1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:25.780084 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.760833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43557 (local address 127.0.0.1:54576)
0808 02:38:25.761090 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.761115 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:25.761255 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:25.772324 (+ 11069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:25.772330 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:25.772378 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:25.772681 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.772698 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.774522 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.774530 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.777112 (+ 2582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.777144 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.779010 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.779026 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.779401 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.779453 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 02:38:25.779578 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 02:38:25.779766 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":170}
I20260808 02:38:25.780113 18221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.760960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54576 (local address 127.10.20.65:43557)
0808 02:38:25.771930 (+ 10970us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:25.771935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:25.771952 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:38:25.772046 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:25.772053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:25.772138 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:25.773094 (+ 956us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:25.773287 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.774309 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.777480 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.778782 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.779366 (+ 584us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.779497 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:25.779608 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 02:38:25.779774 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10841,"thread_start_us":10729,"threads_started":1}
I20260808 02:38:25.781077 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.762491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:38647 (local address 127.0.0.1:43758)
0808 02:38:25.763279 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.763301 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:25.763485 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:25.771705 (+ 8220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:25.771713 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:25.772073 (+ 360us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:25.772644 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.772662 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.774459 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.774465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.777187 (+ 2722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:25.777204 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.779071 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.779083 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:25.780424 (+ 1341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.780471 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 02:38:25.780540 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 02:38:25.780655 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":14,"thread_start_us":658,"threads_started":1}
I20260808 02:38:25.781881 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.763004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43758 (local address 127.10.20.66:38647)
0808 02:38:25.771278 (+ 8274us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:25.771288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:25.771316 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:38:25.771413 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:25.771419 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:25.771511 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:25.772871 (+ 1360us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:25.773080 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.774261 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.777506 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:25.778571 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:25.781355 (+ 2784us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:25.781494 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:25.781548 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 02:38:25.781668 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8074,"thread_start_us":7941,"threads_started":1}
I20260808 02:38:25.782959 18225 tablet_bootstrap.cc:492] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Bootstrap starting.
I20260808 02:38:25.782896 17911 tablet_service.cc:1467] Processing CreateTablet for tablet 36ee8d3358de4354ad43edb970f7a1fa (DEFAULT_TABLE table=test-table [id=42cbe4d27a304c11a60ab2cd364879bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:25.783471 17911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36ee8d3358de4354ad43edb970f7a1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:25.783509 17756 tablet_service.cc:1467] Processing CreateTablet for tablet 36ee8d3358de4354ad43edb970f7a1fa (DEFAULT_TABLE table=test-table [id=42cbe4d27a304c11a60ab2cd364879bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:25.783958 17756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36ee8d3358de4354ad43edb970f7a1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:25.785362 18225 tablet_bootstrap.cc:654] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:25.788494 18225 tablet_bootstrap.cc:492] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: No bootstrap required, opened a new log
I20260808 02:38:25.788726 18225 ts_tablet_manager.cc:1397] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 02:38:25.789785 18225 raft_consensus.cc:348] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.790059 18225 raft_consensus.cc:374] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:25.790162 18225 raft_consensus.cc:729] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86752ca679164d1eb466ea3b00b02dcb, State: Initialized, Role: FOLLOWER
I20260808 02:38:25.790449 18225 consensus_queue.cc:260] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.791491 18225 ts_tablet_manager.cc:1428] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 02:38:25.793447 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.792193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:55529)
0808 02:38:25.792936 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.793139 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":614,"threads_started":1}
I20260808 02:38:25.795804 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.795272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:35489)
0808 02:38:25.795512 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.795624 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260808 02:38:25.797550 18124 heartbeater.cc:503] Master 127.10.20.124:44045 was elected leader, sending a full tablet report...
I20260808 02:38:25.800671 18229 tablet_bootstrap.cc:492] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Bootstrap starting.
I20260808 02:38:25.803519 18229 tablet_bootstrap.cc:654] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:25.803719 18228 tablet_bootstrap.cc:492] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Bootstrap starting.
I20260808 02:38:25.806097 18228 tablet_bootstrap.cc:654] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:25.806254 18229 tablet_bootstrap.cc:492] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: No bootstrap required, opened a new log
I20260808 02:38:25.806437 18229 ts_tablet_manager.cc:1397] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 02:38:25.807402 18229 raft_consensus.cc:348] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.807690 18229 raft_consensus.cc:374] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:25.807804 18229 raft_consensus.cc:729] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af1bac4b7114a8dbb92fdb2aa3c9946, State: Initialized, Role: FOLLOWER
I20260808 02:38:25.808115 18229 consensus_queue.cc:260] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.809167 18229 ts_tablet_manager.cc:1428] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:38:25.810732 18234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.809458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:57481)
0808 02:38:25.810201 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.810400 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":390,"threads_started":1}
I20260808 02:38:25.812304 17979 heartbeater.cc:503] Master 127.10.20.124:44045 was elected leader, sending a full tablet report...
I20260808 02:38:25.812605 18234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.811704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:34441)
0808 02:38:25.811893 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.812435 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 02:38:25.813156 18228 tablet_bootstrap.cc:492] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: No bootstrap required, opened a new log
I20260808 02:38:25.813372 18228 ts_tablet_manager.cc:1397] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260808 02:38:25.814419 18228 raft_consensus.cc:348] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.814812 18228 raft_consensus.cc:374] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:25.814925 18228 raft_consensus.cc:729] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c7a157d8aa4525969ccdfc569f15ca, State: Initialized, Role: FOLLOWER
I20260808 02:38:25.815222 18228 consensus_queue.cc:260] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.816561 18228 ts_tablet_manager.cc:1428] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 02:38:25.817785 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.816504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:36095)
0808 02:38:25.817244 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.817456 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":398,"threads_started":1}
I20260808 02:38:25.819003 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.818513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:59021)
0808 02:38:25.818724 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.818832 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 02:38:25.819205 17822 heartbeater.cc:503] Master 127.10.20.124:44045 was elected leader, sending a full tablet report...
I20260808 02:38:25.984042 18227 raft_consensus.cc:482] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:25.984368 18227 raft_consensus.cc:504] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.985101 18227 leader_election.cc:288] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557), 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647)
I20260808 02:38:25.985945 17776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36ee8d3358de4354ad43edb970f7a1fa" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" is_pre_election: true
I20260808 02:38:25.985997 17932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36ee8d3358de4354ad43edb970f7a1fa" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" is_pre_election: true
I20260808 02:38:25.986277 17932 raft_consensus.cc:2454] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 0.
I20260808 02:38:25.986277 17776 raft_consensus.cc:2454] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 0.
I20260808 02:38:25.987079 18009 leader_election.cc:302] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 86752ca679164d1eb466ea3b00b02dcb, 9af1bac4b7114a8dbb92fdb2aa3c9946, f8c7a157d8aa4525969ccdfc569f15ca; no voters:
I20260808 02:38:25.987596 18227 raft_consensus.cc:2781] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:25.987812 18227 raft_consensus.cc:482] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:25.987952 18227 raft_consensus.cc:3037] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:25.990324 18227 raft_consensus.cc:504] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.991189 18227 leader_election.cc:288] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 election: Requested vote from peers f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557), 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647)
I20260808 02:38:25.991905 17776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36ee8d3358de4354ad43edb970f7a1fa" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c7a157d8aa4525969ccdfc569f15ca"
I20260808 02:38:25.991927 17932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36ee8d3358de4354ad43edb970f7a1fa" candidate_uuid: "86752ca679164d1eb466ea3b00b02dcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946"
I20260808 02:38:25.992158 17932 raft_consensus.cc:3037] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:25.992183 17776 raft_consensus.cc:3037] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:25.994544 17932 raft_consensus.cc:2454] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 1.
I20260808 02:38:25.994637 17776 raft_consensus.cc:2454] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86752ca679164d1eb466ea3b00b02dcb in term 1.
I20260808 02:38:25.995272 18009 leader_election.cc:302] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 86752ca679164d1eb466ea3b00b02dcb, 9af1bac4b7114a8dbb92fdb2aa3c9946, f8c7a157d8aa4525969ccdfc569f15ca; no voters:
I20260808 02:38:25.995725 18227 raft_consensus.cc:2781] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:25.996732 18227 raft_consensus.cc:686] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 1 LEADER]: Becoming Leader. State: Replica: 86752ca679164d1eb466ea3b00b02dcb, State: Running, Role: LEADER
I20260808 02:38:25.997114 18227 consensus_queue.cc:237] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } }
I20260808 02:38:25.998057 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:25.997484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:49449)
0808 02:38:25.997692 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:25.997836 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 02:38:26.000862 17636 catalog_manager.cc:5495] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb reported cstate change: term changed from 0 to 1, leader changed from <none> to 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67). New cstate: current_term: 1 leader_uuid: "86752ca679164d1eb466ea3b00b02dcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86752ca679164d1eb466ea3b00b02dcb" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 } health_report { overall_health: UNKNOWN } } }
I20260808 02:38:26.040412 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.034380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.10.20.67:39419)
0808 02:38:26.034651 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:26.034662 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:26.034728 (+ 66us) server_negotiation.cc:407] Connection header received
0808 02:38:26.035026 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:26.035031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:26.035105 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:26.035222 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:26.035792 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.036641 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.038282 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.038881 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.039004 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:26.039526 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:26.039650 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:26.039731 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:26.039900 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 02:38:26.039983 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 02:38:26.044664 17776 raft_consensus.cc:1261] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Refusing update from remote peer 86752ca679164d1eb466ea3b00b02dcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:26.044663 17932 raft_consensus.cc:1261] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Refusing update from remote peer 86752ca679164d1eb466ea3b00b02dcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:26.045514 18237 consensus_queue.cc:1035] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9af1bac4b7114a8dbb92fdb2aa3c9946" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:26.045928 18227 consensus_queue.cc:1035] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8c7a157d8aa4525969ccdfc569f15ca" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:26.050184 18234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.049373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:42391)
0808 02:38:26.049714 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.049876 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260808 02:38:26.051306 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.048881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:51157)
0808 02:38:26.050868 (+ 1987us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.051029 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1809}
I20260808 02:38:26.058223 18241 mvcc.cc:205] Tried to move back new op lower bound from 7316097867951243264 to 7316097867768020992. Current Snapshot: MvccSnapshot[applied={T|T < 7316097867951243264}]
I20260808 02:38:26.058694 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.058129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.65:39827)
0808 02:38:26.058378 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.058482 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260808 02:38:26.059593 18234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.058919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.66:54795)
0808 02:38:26.059191 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.059301 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 02:38:26.066771 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.066097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:60187)
0808 02:38:26.066436 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.066521 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227}
I20260808 02:38:26.068936 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.068413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.10.20.67:57939)
0808 02:38:26.068609 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.068730 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 02:38:26.073366 17636 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:26.073634 17636 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:26.080843 17636 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97e0419767324365898711591ae0de53: Sending DeleteTablet for 3 replicas of tablet 36ee8d3358de4354ad43edb970f7a1fa
I20260808 02:38:26.082199 18057 tablet_service.cc:1514] Processing DeleteTablet for tablet 36ee8d3358de4354ad43edb970f7a1fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:26 UTC) from {username='oryx', principal='oryx/127.10.20.124@KRBTEST.COM'} at 127.0.0.1:60872
I20260808 02:38:26.082224 17756 tablet_service.cc:1514] Processing DeleteTablet for tablet 36ee8d3358de4354ad43edb970f7a1fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:26 UTC) from {username='oryx', principal='oryx/127.10.20.124@KRBTEST.COM'} at 127.0.0.1:54576
I20260808 02:38:26.082494 17911 tablet_service.cc:1514] Processing DeleteTablet for tablet 36ee8d3358de4354ad43edb970f7a1fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:26 UTC) from {username='oryx', principal='oryx/127.10.20.124@KRBTEST.COM'} at 127.0.0.1:43758
I20260808 02:38:26.083281 18248 tablet_replica.cc:330] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: stopping tablet replica
I20260808 02:38:26.083616 18248 raft_consensus.cc:2229] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:26.084084 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17614
I20260808 02:38:26.084307 18248 raft_consensus.cc:2258] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:26.084395 18249 tablet_replica.cc:330] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: stopping tablet replica
I20260808 02:38:26.084692 18249 raft_consensus.cc:2229] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:26.085114 18249 raft_consensus.cc:2258] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:26.086169 18248 ts_tablet_manager.cc:1905] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:26.087123 18249 ts_tablet_manager.cc:1905] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:26.094321 18248 ts_tablet_manager.cc:1918] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:26.094645 18248 log.cc:1196] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/36ee8d3358de4354ad43edb970f7a1fa
I20260808 02:38:26.095512 18248 ts_tablet_manager.cc:1939] T 36ee8d3358de4354ad43edb970f7a1fa P 86752ca679164d1eb466ea3b00b02dcb: Deleting consensus metadata
I20260808 02:38:26.096669 18249 ts_tablet_manager.cc:1918] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:26.097116 17621 catalog_manager.cc:4841] TS 86752ca679164d1eb466ea3b00b02dcb (127.10.20.67:39419): tablet 36ee8d3358de4354ad43edb970f7a1fa (table test-table [id=42cbe4d27a304c11a60ab2cd364879bf]) successfully deleted
I20260808 02:38:26.097465 18249 log.cc:1196] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/36ee8d3358de4354ad43edb970f7a1fa
I20260808 02:38:26.097949 18249 ts_tablet_manager.cc:1939] T 36ee8d3358de4354ad43edb970f7a1fa P f8c7a157d8aa4525969ccdfc569f15ca: Deleting consensus metadata
I20260808 02:38:26.099287 18250 tablet_replica.cc:330] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: stopping tablet replica
I20260808 02:38:26.099395 17621 catalog_manager.cc:4841] TS f8c7a157d8aa4525969ccdfc569f15ca (127.10.20.65:43557): tablet 36ee8d3358de4354ad43edb970f7a1fa (table test-table [id=42cbe4d27a304c11a60ab2cd364879bf]) successfully deleted
I20260808 02:38:26.099574 18250 raft_consensus.cc:2229] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:26.100016 18250 raft_consensus.cc:2258] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:26.101279 18250 ts_tablet_manager.cc:1905] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:26.109103 18250 ts_tablet_manager.cc:1918] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:26.109288 18250 log.cc:1196] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/36ee8d3358de4354ad43edb970f7a1fa
I20260808 02:38:26.109802 18250 ts_tablet_manager.cc:1939] T 36ee8d3358de4354ad43edb970f7a1fa P 9af1bac4b7114a8dbb92fdb2aa3c9946: Deleting consensus metadata
I20260808 02:38:26.111279 17624 catalog_manager.cc:4841] TS 9af1bac4b7114a8dbb92fdb2aa3c9946 (127.10.20.66:38647): tablet 36ee8d3358de4354ad43edb970f7a1fa (table test-table [id=42cbe4d27a304c11a60ab2cd364879bf]) successfully deleted
I20260808 02:38:26.111660 18221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.085509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54578 (local address 127.10.20.65:43557)
0808 02:38:26.085801 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:26.085811 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:26.091515 (+ 5704us) server_negotiation.cc:407] Connection header received
0808 02:38:26.091768 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:26.091775 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:26.091874 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:26.092008 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:26.094538 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.095908 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.098539 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.099332 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.099498 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:26.102506 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:26.102533 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:26.102559 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:26.102621 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:26.107731 (+ 5110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:26.108849 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:26.108861 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:26.108864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:26.109089 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:26.109742 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:26.109749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:26.109755 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:26.110287 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:26.110608 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:26.110997 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 02:38:26.111293 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 02:38:26.112437 17817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:26.173517 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.173022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55816)
0808 02:38:26.173227 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.173335 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 02:38:26.174945 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.174330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55818)
0808 02:38:26.174597 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.174769 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 02:38:26.220059 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17614
I20260808 02:38:26.241845 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17842
I20260808 02:38:26.257727 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.242788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43766 (local address 127.10.20.66:38647)
0808 02:38:26.243002 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:26.243007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:26.243026 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:38:26.243280 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:26.243284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:26.243364 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:26.243452 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:26.244882 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.245624 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.247089 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.247541 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.247651 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:26.250633 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:26.250652 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:26.250670 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:26.250815 (+ 145us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:26.254221 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:26.255213 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:26.255223 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:26.255227 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:26.255437 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:26.255971 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:26.255976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:26.255978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:26.256426 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:26.256681 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:26.257125 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 02:38:26.257428 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:38:26.258752 17972 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:26.363981 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17842
I20260808 02:38:26.385192 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17992
I20260808 02:38:26.401280 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.385987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.10.20.67:39419)
0808 02:38:26.386162 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:26.386167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:26.386185 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:38:26.386403 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:26.386408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:26.386498 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:26.386610 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:26.388114 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.388866 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.390398 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:26.391030 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:26.391148 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:26.394122 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:26.394141 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:26.394173 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:26.394217 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:26.397483 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:26.398483 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:26.398491 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:26.398494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:26.398744 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:26.399286 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:26.399290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:26.399292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:26.399737 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:26.400073 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:26.400517 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 02:38:26.400743 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:38:26.401999 18119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:26.537554 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17992
I20260808 02:38:26.564266 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17294
I20260808 02:38:26.565514 17470 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:26.699676 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17294
I20260808 02:38:26.711611 18256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.710767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55826)
0808 02:38:26.711301 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.711441 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":297,"threads_started":1}
I20260808 02:38:26.713158 18256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:26.712782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37293 (local address 127.0.0.1:55842)
0808 02:38:26.712945 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:26.713026 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:37293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 02:38:26.726207 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 17403
I20260808 02:38:26.727476 17669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:26.860129 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 17403
2026-08-08T02:38:26Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11794 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:38:27 dist-test-slave-8tdl krb5kdc[18261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:38:27 dist-test-slave-8tdl krb5kdc[18261](info): set up 2 sockets
Aug 08 02:38:27 dist-test-slave-8tdl krb5kdc[18261](info): commencing operation
krb5kdc: starting...
W20260808 02:38:28.087914 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.004s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:38:28 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:38:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab.
Entry for principal oryx/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab.
I20260808 02:38:28.424782 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35493
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab
--principal=oryx/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:35493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:28.852257 18276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:28.852784 18276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:28.853075 18276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:28.862625 18276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:28.862954 18276 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 02:38:28.863057 18276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:28.863171 18276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:28.863282 18276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:28.863407 18276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:28.876034 18276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:35493
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.126.keytab
--principal=oryx/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:28.877810 18276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:28.880311 18276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:28.898011 18284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:28.898075 18282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:28.898458 18281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:28.899137 18276 server_base.cc:1034] running on GCE node
I20260808 02:38:28.900269 18276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:28.902298 18276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:28.903635 18276 hybrid_clock.cc:648] HybridClock initialized: now 1786156708903530 us; error 76 us; skew 500 ppm
I20260808 02:38:28.904145 18276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:28 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156708, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:28.909195 18276 init.cc:377] Logged in from keytab as oryx/127.10.20.126@KRBTEST.COM (short username oryx)
I20260808 02:38:28.911427 18276 webserver.cc:460] Webserver started at http://127.10.20.126:38497/ using document root <none> and password file <none>
I20260808 02:38:28.912350 18276 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:28.912472 18276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:28.912964 18276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:28.916676 18276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "7cae7f47591747099d577ff40979d5ee"
format_stamp: "Formatted at 2026-08-08 02:38:28 on dist-test-slave-8tdl"
server_key: "1a524bd16e246856d26c0cc42eeabf11"
server_key_iv: "2eb53ba21804adeb79645d68427dce12"
server_key_version: "encryptionkey@0"
I20260808 02:38:28.917755 18276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "7cae7f47591747099d577ff40979d5ee"
format_stamp: "Formatted at 2026-08-08 02:38:28 on dist-test-slave-8tdl"
server_key: "1a524bd16e246856d26c0cc42eeabf11"
server_key_iv: "2eb53ba21804adeb79645d68427dce12"
server_key_version: "encryptionkey@0"
I20260808 02:38:28.925968 18276 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260808 02:38:28.930860 18291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:28.932935 18276 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:38:28.933319 18276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "7cae7f47591747099d577ff40979d5ee"
format_stamp: "Formatted at 2026-08-08 02:38:28 on dist-test-slave-8tdl"
server_key: "1a524bd16e246856d26c0cc42eeabf11"
server_key_iv: "2eb53ba21804adeb79645d68427dce12"
server_key_version: "encryptionkey@0"
I20260808 02:38:28.933656 18276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:28.955772 18276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:28.963982 18276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:28.964704 18276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:29.001809 18355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:35493 every 8 connection(s)
I20260808 02:38:29.001904 18276 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:35493
I20260808 02:38:29.005234 18276 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:29.011132 18356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:29.014118 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 18276
I20260808 02:38:29.014453 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:29.015439 10321 external_mini_cluster.cc:1428] Setting key 307861fb440e427cf84626ee04c0953b
I20260808 02:38:29.030004 18356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Bootstrap starting.
I20260808 02:38:29.035164 18356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:29.036819 18356 log.cc:824] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:29.041153 18356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: No bootstrap required, opened a new log
Aug 08 02:38:29 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:29.055518 18356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cae7f47591747099d577ff40979d5ee" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35493 } }
I20260808 02:38:29.055857 18359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:29.019859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34816 (local address 127.10.20.126:35493)
0808 02:38:29.021575 (+ 1716us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:29.021591 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:29.021646 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:38:29.026301 (+ 4655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:29.026339 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:29.027183 (+ 844us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:29.027680 (+ 497us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:29.030928 (+ 3248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.033046 (+ 2118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.035522 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.036425 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.037251 (+ 826us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:29.043562 (+ 6311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:29.043573 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:29.043591 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:29.043646 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:29.048767 (+ 5121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:29.050321 (+ 1554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:29.050331 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:29.050341 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:29.050778 (+ 437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:29.051570 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:29.051575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:29.051577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:29.052622 (+ 1045us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:29.052979 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:29.053770 (+ 791us) server_negotiation.cc:299] Negotiation successful
0808 02:38:29.054455 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1125,"thread_start_us":603,"threads_started":1}
I20260808 02:38:29.056092 18356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:29.056272 18356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cae7f47591747099d577ff40979d5ee, State: Initialized, Role: FOLLOWER
I20260808 02:38:29.057075 18356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cae7f47591747099d577ff40979d5ee" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35493 } }
I20260808 02:38:29.057420 18356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:29.057581 18356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:29.057797 18356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:29.061510 18356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cae7f47591747099d577ff40979d5ee" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35493 } }
I20260808 02:38:29.062289 18356 leader_election.cc:302] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cae7f47591747099d577ff40979d5ee; no voters:
I20260808 02:38:29.063261 18356 leader_election.cc:288] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:29.063553 18361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:29.064800 18361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [term 1 LEADER]: Becoming Leader. State: Replica: 7cae7f47591747099d577ff40979d5ee, State: Running, Role: LEADER
I20260808 02:38:29.065716 18361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cae7f47591747099d577ff40979d5ee" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35493 } }
I20260808 02:38:29.066437 18356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:29.071020 18362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cae7f47591747099d577ff40979d5ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cae7f47591747099d577ff40979d5ee" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35493 } } }
I20260808 02:38:29.071539 18362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:29.070724 18363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cae7f47591747099d577ff40979d5ee. Latest consensus state: current_term: 1 leader_uuid: "7cae7f47591747099d577ff40979d5ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cae7f47591747099d577ff40979d5ee" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35493 } } }
I20260808 02:38:29.072124 18363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:29.079387 18370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:29.088431 18370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:29.103595 18370 catalog_manager.cc:1347] Generated new cluster ID: d56296818fb94a378210c22336613ea7
I20260808 02:38:29.104043 18370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:29.127216 18370 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:29.129108 18370 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:29.138304 18370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Generated new TSK 0
I20260808 02:38:29.139664 18370 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab.
Entry for principal oryx/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab.
I20260808 02:38:29.245373 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35493
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:29.667644 18383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:29.668037 18383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:29.668205 18383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:29.676426 18383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:29.676642 18383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:29.676819 18383 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:38:29.676960 18383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:29.688738 18383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:35493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:29.690621 18383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:29.692497 18383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:29.709470 18389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:29.709546 18388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:29.709501 18391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:29.716930 18383 server_base.cc:1034] running on GCE node
I20260808 02:38:29.717746 18383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:29.719098 18383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:29.720422 18383 hybrid_clock.cc:648] HybridClock initialized: now 1786156709720355 us; error 45 us; skew 500 ppm
I20260808 02:38:29.721268 18383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:29 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156709, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:29.726037 18383 init.cc:377] Logged in from keytab as oryx/127.10.20.65@KRBTEST.COM (short username oryx)
I20260808 02:38:29.729122 18383 webserver.cc:460] Webserver started at http://127.10.20.65:44771/ using document root <none> and password file <none>
I20260808 02:38:29.730300 18383 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:29.730465 18383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:29.730940 18383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:29.734745 18383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "29859a125675468383936fe7a4d4ce47"
format_stamp: "Formatted at 2026-08-08 02:38:29 on dist-test-slave-8tdl"
server_key: "67396fa7997c6740d83ca43792597727"
server_key_iv: "4dc879ff4001dcdf7da6fe80e88ea8e5"
server_key_version: "encryptionkey@0"
I20260808 02:38:29.736094 18383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "29859a125675468383936fe7a4d4ce47"
format_stamp: "Formatted at 2026-08-08 02:38:29 on dist-test-slave-8tdl"
server_key: "67396fa7997c6740d83ca43792597727"
server_key_iv: "4dc879ff4001dcdf7da6fe80e88ea8e5"
server_key_version: "encryptionkey@0"
I20260808 02:38:29.743747 18383 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:38:29.749452 18398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:29.751883 18383 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260808 02:38:29.752149 18383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "29859a125675468383936fe7a4d4ce47"
format_stamp: "Formatted at 2026-08-08 02:38:29 on dist-test-slave-8tdl"
server_key: "67396fa7997c6740d83ca43792597727"
server_key_iv: "4dc879ff4001dcdf7da6fe80e88ea8e5"
server_key_version: "encryptionkey@0"
I20260808 02:38:29.752453 18383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:29.791821 18383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:29.797080 18383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:29.797411 18383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:29.800675 18383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:29.800808 18383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:29.801007 18383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:29.801096 18383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:38:29 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156709, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:29.831313 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:29.801589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:43217 (local address 127.10.20.126:35493)
0808 02:38:29.802273 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:29.802280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:29.803934 (+ 1654us) server_negotiation.cc:407] Connection header received
0808 02:38:29.806859 (+ 2925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:29.806867 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:29.806977 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:29.807116 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:29.809861 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.811062 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.813946 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.814586 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.814818 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:29.822010 (+ 7192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:29.822024 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:29.822032 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:29.822089 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:29.826762 (+ 4673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:29.828217 (+ 1455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:29.828227 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:29.828232 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:29.828493 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:29.829156 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:29.829162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:29.829165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:29.829548 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:29.829721 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:29.830589 (+ 868us) server_negotiation.cc:299] Negotiation successful
0808 02:38:29.830899 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":380,"threads_started":1}
I20260808 02:38:29.833025 18408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:29.802419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.10.20.65:43217)
0808 02:38:29.803703 (+ 1284us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:29.803759 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:29.806405 (+ 2646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:29.807482 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:29.807499 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:29.808493 (+ 994us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:29.809572 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:29.809608 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.811269 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.811273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:29.813611 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:29.813631 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.815078 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.815096 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:29.815598 (+ 502us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:29.816743 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:29.816794 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:29.821505 (+ 4711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:29.827074 (+ 5569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:29.827092 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:29.827117 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:29.828013 (+ 896us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:29.828690 (+ 677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:29.828702 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:29.828708 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:29.828998 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:29.829713 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:29.829721 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:29.830186 (+ 465us) client_negotiation.cc:769] Sending connection context
0808 02:38:29.830497 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 02:38:29.831191 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":728,"threads_started":1}
I20260808 02:38:29.864073 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:29.842910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.10.20.65:46965)
0808 02:38:29.844385 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:29.844424 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:29.844615 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:29.845043 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:29.845047 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:29.845732 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:29.846064 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:29.846082 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.847353 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.847360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:29.849659 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:29.849684 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.850889 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.850900 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:29.851195 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:29.852346 (+ 1151us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:29.852383 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:29.854003 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:29.859491 (+ 5488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:29.859497 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:29.859500 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:29.860064 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:29.861148 (+ 1084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:29.861153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:29.861156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:29.861323 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:29.862420 (+ 1097us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:29.862424 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:29.862656 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 02:38:29.863019 (+ 363us) client_negotiation.cc:240] Negotiation successful
0808 02:38:29.863539 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1281,"thread_start_us":1137,"threads_started":1}
I20260808 02:38:29.864111 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:29.842872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:46965 (local address 127.10.20.126:35493)
0808 02:38:29.843118 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:29.843125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:29.844537 (+ 1412us) server_negotiation.cc:407] Connection header received
0808 02:38:29.844779 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:29.844786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:29.844877 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:29.845005 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:29.846262 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.847150 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.849966 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:29.850557 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:29.850800 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:29.854398 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:29.854416 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:29.854420 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:29.854461 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:29.859207 (+ 4746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:29.860527 (+ 1320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:29.860540 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:29.860547 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:29.860842 (+ 295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:29.861482 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:29.861490 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:29.861496 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:29.862045 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:29.862390 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:29.863186 (+ 796us) server_negotiation.cc:299] Negotiation successful
0808 02:38:29.863588 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:38:29.874424 18526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:40047 every 8 connection(s)
I20260808 02:38:29.874439 18383 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:40047
I20260808 02:38:29.876147 18383 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:29.879751 18527 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35493
I20260808 02:38:29.880086 18527 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:29.880911 18527 heartbeater.cc:511] Master 127.10.20.126:35493 requested a full tablet report, sending...
I20260808 02:38:29.884236 18310 ts_manager.cc:194] Registered new tserver with Master: 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047)
I20260808 02:38:29.885007 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 18383
I20260808 02:38:29.885242 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:38:29.886123 10321 external_mini_cluster.cc:1428] Setting key 4d13458db3564d6af2168e1db8735d0d
I20260808 02:38:29.886480 18310 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:43217
WARNING: no policy specified for oryx/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab.
Entry for principal oryx/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab.
I20260808 02:38:29.969005 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35493
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:30.375167 18531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:30.375551 18531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:30.375730 18531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:30.383855 18531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:30.383991 18531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:30.384128 18531 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:38:30.384286 18531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:30.395082 18531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:35493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:30.396610 18531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:30.398144 18531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:30.415205 18537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:30.415679 18536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:30.415791 18531 server_base.cc:1034] running on GCE node
W20260808 02:38:30.415675 18539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:30.417135 18531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:30.418306 18531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:30.419688 18531 hybrid_clock.cc:648] HybridClock initialized: now 1786156710419597 us; error 66 us; skew 500 ppm
I20260808 02:38:30.420362 18531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:30 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156710, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:30.424706 18531 init.cc:377] Logged in from keytab as oryx/127.10.20.66@KRBTEST.COM (short username oryx)
I20260808 02:38:30.426748 18531 webserver.cc:460] Webserver started at http://127.10.20.66:45109/ using document root <none> and password file <none>
I20260808 02:38:30.427623 18531 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:30.427778 18531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:30.428172 18531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:30.432269 18531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "934084151eda4cb0a84c5e0dd44e8c04"
format_stamp: "Formatted at 2026-08-08 02:38:30 on dist-test-slave-8tdl"
server_key: "25cb700aaae330f5deb2bc9724f71566"
server_key_iv: "850e9dbdab74c1ea24bba5ac6036d884"
server_key_version: "encryptionkey@0"
I20260808 02:38:30.433351 18531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "934084151eda4cb0a84c5e0dd44e8c04"
format_stamp: "Formatted at 2026-08-08 02:38:30 on dist-test-slave-8tdl"
server_key: "25cb700aaae330f5deb2bc9724f71566"
server_key_iv: "850e9dbdab74c1ea24bba5ac6036d884"
server_key_version: "encryptionkey@0"
I20260808 02:38:30.440753 18531 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
I20260808 02:38:30.446563 18546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:30.449272 18531 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260808 02:38:30.449568 18531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "934084151eda4cb0a84c5e0dd44e8c04"
format_stamp: "Formatted at 2026-08-08 02:38:30 on dist-test-slave-8tdl"
server_key: "25cb700aaae330f5deb2bc9724f71566"
server_key_iv: "850e9dbdab74c1ea24bba5ac6036d884"
server_key_version: "encryptionkey@0"
I20260808 02:38:30.449879 18531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:30.487021 18531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:30.493379 18531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:30.493770 18531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:30.497665 18531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:30.497804 18531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:30.497987 18531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:30.498062 18531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:38:30 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156710, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:30.529651 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:30.498777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:54373 (local address 127.10.20.126:35493)
0808 02:38:30.499629 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:30.499648 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:30.500948 (+ 1300us) server_negotiation.cc:407] Connection header received
0808 02:38:30.503745 (+ 2797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:30.503755 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:30.503879 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:30.503975 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:30.507551 (+ 3576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.509009 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.512979 (+ 3970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.513908 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.514092 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:30.520201 (+ 6109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:30.520208 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:30.520212 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:30.520254 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:30.523834 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:30.525412 (+ 1578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:30.525418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:30.525421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:30.525624 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:30.526460 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:30.526465 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:30.526468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:30.527077 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:30.527306 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:30.529004 (+ 1698us) server_negotiation.cc:299] Negotiation successful
0808 02:38:30.529299 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":310,"threads_started":1}
I20260808 02:38:30.531905 18556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:30.499524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.10.20.66:54373)
0808 02:38:30.500582 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:30.500632 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:30.503265 (+ 2633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:30.504615 (+ 1350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:30.504632 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:30.505735 (+ 1103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:30.507113 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:30.507146 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.509325 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.509331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:30.512566 (+ 3235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:30.512606 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.514483 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.514490 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:30.514834 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:30.515900 (+ 1066us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:30.515946 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:30.519755 (+ 3809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:30.524090 (+ 4335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:30.524107 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:30.524140 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:30.525151 (+ 1011us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:30.525781 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:30.525790 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:30.525796 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:30.526211 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:30.527269 (+ 1058us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:30.527287 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:30.528069 (+ 782us) client_negotiation.cc:769] Sending connection context
0808 02:38:30.528551 (+ 482us) client_negotiation.cc:240] Negotiation successful
0808 02:38:30.529447 (+ 896us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":408,"threads_started":1}
I20260808 02:38:30.563387 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:30.541495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:39221 (local address 127.10.20.126:35493)
0808 02:38:30.541773 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:30.541784 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:30.542579 (+ 795us) server_negotiation.cc:407] Connection header received
0808 02:38:30.542890 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:30.542896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:30.542974 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:30.543079 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:30.545104 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.545993 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.548857 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.549357 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.549486 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:30.553315 (+ 3829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:30.553322 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:30.553325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:30.553372 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:30.557574 (+ 4202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:30.559433 (+ 1859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:30.559438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:30.559441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:30.559644 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:30.560384 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:30.560392 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:30.560395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:30.561052 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:30.561444 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:30.562413 (+ 969us) server_negotiation.cc:299] Negotiation successful
0808 02:38:30.562799 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 02:38:30.563766 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:30.541519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.10.20.66:39221)
0808 02:38:30.542366 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:30.542396 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:30.542653 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:30.543158 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:30.543166 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:30.544083 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:30.544846 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:30.544869 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.546216 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.546225 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:30.548595 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:30.548618 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:30.549635 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:30.549647 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:30.550048 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:30.551241 (+ 1193us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:30.551277 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:30.552902 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:30.557925 (+ 5023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:30.557936 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:30.557944 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:30.559144 (+ 1200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:30.559797 (+ 653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:30.559805 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:30.559813 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:30.560073 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:30.561449 (+ 1376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:30.561459 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:30.561859 (+ 400us) client_negotiation.cc:769] Sending connection context
0808 02:38:30.562116 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 02:38:30.562750 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":421,"threads_started":1}
I20260808 02:38:30.571071 18531 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:34389
I20260808 02:38:30.571096 18671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:34389 every 8 connection(s)
I20260808 02:38:30.572695 18531 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:30.576086 18672 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35493
I20260808 02:38:30.576392 18672 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:30.577183 18672 heartbeater.cc:511] Master 127.10.20.126:35493 requested a full tablet report, sending...
I20260808 02:38:30.578509 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 18531
I20260808 02:38:30.578836 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:38:30.579241 18309 ts_manager.cc:194] Registered new tserver with Master: 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389)
I20260808 02:38:30.579377 10321 external_mini_cluster.cc:1428] Setting key 0fe15a2080c91adff49896bd0edd3f4c
I20260808 02:38:30.580404 18309 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:54373
WARNING: no policy specified for oryx/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab.
Entry for principal oryx/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab.
I20260808 02:38:30.653314 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:35493
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:34485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:30.891260 18527 heartbeater.cc:503] Master 127.10.20.126:35493 was elected leader, sending a full tablet report...
W20260808 02:38:31.049360 18676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:31.049700 18676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:31.049809 18676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:31.058045 18676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:31.058189 18676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:31.058350 18676 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 02:38:31.058461 18676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:31.069631 18676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.20.126:35493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:31.071271 18676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:31.072831 18676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:31.089439 18681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:31.089588 18684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:31.089709 18682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:31.092145 18676 server_base.cc:1034] running on GCE node
I20260808 02:38:31.093242 18676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:31.094830 18676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:31.096143 18676 hybrid_clock.cc:648] HybridClock initialized: now 1786156711096072 us; error 53 us; skew 500 ppm
I20260808 02:38:31.096567 18676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:31 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156711, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:31.105871 18676 init.cc:377] Logged in from keytab as oryx/127.10.20.67@KRBTEST.COM (short username oryx)
I20260808 02:38:31.107918 18676 webserver.cc:460] Webserver started at http://127.10.20.67:37139/ using document root <none> and password file <none>
I20260808 02:38:31.108741 18676 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:31.108999 18676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:31.109702 18676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:31.113555 18676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "523f229b9d294095a6c9636629613e98"
format_stamp: "Formatted at 2026-08-08 02:38:31 on dist-test-slave-8tdl"
server_key: "e5e2aa9771eb70951fb159721344d3e5"
server_key_iv: "0dc0b4cc79e84f9c807cfe038650f774"
server_key_version: "encryptionkey@0"
I20260808 02:38:31.115216 18676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "523f229b9d294095a6c9636629613e98"
format_stamp: "Formatted at 2026-08-08 02:38:31 on dist-test-slave-8tdl"
server_key: "e5e2aa9771eb70951fb159721344d3e5"
server_key_iv: "0dc0b4cc79e84f9c807cfe038650f774"
server_key_version: "encryptionkey@0"
I20260808 02:38:31.122107 18676 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:38:31.127178 18691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:31.129514 18676 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:38:31.129838 18676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "523f229b9d294095a6c9636629613e98"
format_stamp: "Formatted at 2026-08-08 02:38:31 on dist-test-slave-8tdl"
server_key: "e5e2aa9771eb70951fb159721344d3e5"
server_key_iv: "0dc0b4cc79e84f9c807cfe038650f774"
server_key_version: "encryptionkey@0"
I20260808 02:38:31.130124 18676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:31.148524 18676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:31.153486 18676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:31.153821 18676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:31.157207 18676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:31.157308 18676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:31.157545 18676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:31.157631 18676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:38:31 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156711, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:31.186647 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:31.158448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:39129 (local address 127.10.20.126:35493)
0808 02:38:31.159213 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:31.159218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:31.160445 (+ 1227us) server_negotiation.cc:407] Connection header received
0808 02:38:31.163220 (+ 2775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:31.163231 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:31.163362 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:31.163510 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:31.166398 (+ 2888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.167612 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.170705 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.171261 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.171426 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:31.177876 (+ 6450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:31.177885 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:31.177891 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:31.177949 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:31.182351 (+ 4402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:31.183781 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:31.183790 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:31.183793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:31.183969 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:31.184539 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:31.184543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:31.184545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:31.184866 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:31.185043 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:31.185891 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 02:38:31.186166 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":485,"threads_started":1}
I20260808 02:38:31.188449 18701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:31.159255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.10.20.67:39129)
0808 02:38:31.160241 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:31.160285 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:31.162730 (+ 2445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:31.163887 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:31.163907 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:31.164876 (+ 969us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:31.166088 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:31.166133 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.167852 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.167856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:31.170444 (+ 2588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:31.170464 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.171588 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.171596 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:31.171922 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:31.173006 (+ 1084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:31.173078 (+ 72us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:31.177431 (+ 4353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:31.182570 (+ 5139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:31.182582 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:31.182604 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:31.183574 (+ 970us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:31.184117 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:31.184122 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:31.184126 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:31.184388 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:31.185028 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:31.185046 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:31.185489 (+ 443us) client_negotiation.cc:769] Sending connection context
0808 02:38:31.185793 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 02:38:31.186426 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":431,"threads_started":1}
I20260808 02:38:31.215243 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:31.196801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.10.20.67:41615)
0808 02:38:31.197493 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:31.197530 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:31.197764 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:31.198413 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:31.198417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:31.199403 (+ 986us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:31.199983 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:31.200006 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.201663 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.201668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:31.203423 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:31.203444 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.204331 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.204339 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:31.204503 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:31.205203 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:31.205222 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:31.206019 (+ 797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:31.210255 (+ 4236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:31.210265 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:31.210275 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:31.211367 (+ 1092us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:31.211998 (+ 631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:31.212004 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:31.212007 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:31.212254 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:31.213302 (+ 1048us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:31.213315 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:31.213687 (+ 372us) client_negotiation.cc:769] Sending connection context
0808 02:38:31.213942 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 02:38:31.214574 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":386,"threads_started":1}
I20260808 02:38:31.215832 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:31.196593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:41615 (local address 127.10.20.126:35493)
0808 02:38:31.196897 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:31.196906 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:31.197663 (+ 757us) server_negotiation.cc:407] Connection header received
0808 02:38:31.197966 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:31.197974 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:31.198087 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:31.198223 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:31.200282 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.201455 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.203637 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.204095 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.204249 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:31.206287 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:31.206292 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:31.206296 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:31.206332 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:31.209957 (+ 3625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:31.211642 (+ 1685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:31.211648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:31.211654 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:31.211853 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:31.212433 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:31.212450 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:31.212457 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:31.212973 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:31.213202 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:31.214944 (+ 1742us) server_negotiation.cc:299] Negotiation successful
0808 02:38:31.215388 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:38:31.221643 18676 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:37033
I20260808 02:38:31.221660 18815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:37033 every 8 connection(s)
I20260808 02:38:31.223239 18676 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:31.226051 18816 heartbeater.cc:347] Connected to a master server at 127.10.20.126:35493
I20260808 02:38:31.226366 18816 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:31.227203 18816 heartbeater.cc:511] Master 127.10.20.126:35493 requested a full tablet report, sending...
I20260808 02:38:31.228925 18310 ts_manager.cc:194] Registered new tserver with Master: 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:31.229842 18310 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:39129
I20260808 02:38:31.230655 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 18676
I20260808 02:38:31.230954 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:38:31.231549 10321 external_mini_cluster.cc:1428] Setting key cfc880bd5bc15abf359b7358396ef9cf
I20260808 02:38:31.235625 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:38:31 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156711, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 02:38:31 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:31 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:31.583896 18672 heartbeater.cc:503] Master 127.10.20.126:35493 was elected leader, sending a full tablet report...
I20260808 02:38:32.233672 18816 heartbeater.cc:503] Master 127.10.20.126:35493 was elected leader, sending a full tablet report...
W20260808 02:38:32.456728 18824 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.151s user 0.005s sys 0.020s
W20260808 02:38:32.458266 18700 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:31.298793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.10.20.126:35493)
0808 02:38:31.299013 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:31.299018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:31.299268 (+ 250us) server_negotiation.cc:407] Connection header received
0808 02:38:31.299534 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:31.299539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:31.299612 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:31.299721 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:31.301617 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.302424 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.304106 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:31.304634 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:31.304760 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.457933 (+1153173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34830: BlockingRecv error: recv got EOF from 127.0.0.1:34830 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 02:38:32 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156711, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:32.481840 18700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.462924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34844 (local address 127.10.20.126:35493)
0808 02:38:32.463204 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.463211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.463576 (+ 365us) server_negotiation.cc:407] Connection header received
0808 02:38:32.463725 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.463730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.463802 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.463899 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:32.465428 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.466276 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.467926 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.468547 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.468668 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.473721 (+ 5053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:32.473727 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:32.473731 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:32.473779 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:32.477732 (+ 3953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:32.479083 (+ 1351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:32.479089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:32.479091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:32.479283 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:32.479864 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:32.479868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:32.479870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:32.480391 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:32.480667 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.481190 (+ 523us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.481492 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 02:38:32.488301 18310 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:32.501780 18310 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:32.532577 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.519022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37033 (local address 127.0.0.1:43564)
0808 02:38:32.520475 (+ 1453us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.520548 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.520835 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.524348 (+ 3513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.524353 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.524380 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.524813 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.524829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.526812 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.526820 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.529272 (+ 2452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.529295 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.531584 (+ 2289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.531592 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.531813 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.531847 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.531945 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.532109 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026,"mutex_wait_us":2,"thread_start_us":844,"threads_started":1}
I20260808 02:38:32.533360 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.519521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34389 (local address 127.0.0.1:40280)
0808 02:38:32.522046 (+ 2525us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.522076 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.522337 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.523565 (+ 1228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.523575 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.523610 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.524119 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.524137 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.526349 (+ 2212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.526354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.529127 (+ 2773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.529145 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.531159 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.531166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.531416 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.531565 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.531732 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.531948 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2371,"thread_start_us":2209,"threads_started":1}
I20260808 02:38:32.533550 18837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.519337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43564 (local address 127.10.20.67:37033)
0808 02:38:32.523649 (+ 4312us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.523662 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.523704 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:38:32.523839 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.523850 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.524155 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.524395 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.525055 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.526614 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.529500 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.531303 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.531468 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.531670 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.533027 (+ 1357us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.533239 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4086,"thread_start_us":3918,"threads_started":1}
I20260808 02:38:32.534046 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.522617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.10.20.65:40047)
0808 02:38:32.525114 (+ 2497us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.525121 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.525145 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:38:32.525229 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.525234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.525414 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.525635 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.526192 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.527832 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.530715 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.532251 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.532392 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.532609 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.533466 (+ 857us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.533689 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2325,"thread_start_us":2096,"threads_started":1}
I20260808 02:38:32.534121 18840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.522240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:40047 (local address 127.0.0.1:52906)
0808 02:38:32.523308 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.523361 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.523502 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.525614 (+ 2112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.525619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.525646 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.526001 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.526010 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.528038 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.528044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.530328 (+ 2284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.530345 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.532787 (+ 2442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.532793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.533031 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.533066 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.533155 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.533292 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"mutex_wait_us":1,"thread_start_us":650,"threads_started":1}
I20260808 02:38:32.532779 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.519942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40280 (local address 127.10.20.66:34389)
0808 02:38:32.521550 (+ 1608us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.521558 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.522192 (+ 634us) server_negotiation.cc:407] Connection header received
0808 02:38:32.522540 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.522550 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.522916 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.523197 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.524345 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.526191 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.529380 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.530887 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.531067 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.531318 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.532266 (+ 948us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.532482 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1412,"thread_start_us":1242,"threads_started":1}
I20260808 02:38:32.538022 18599 tablet_service.cc:1467] Processing CreateTablet for tablet 90641add93934d5499d83914f88d1df1 (DEFAULT_TABLE table=test-table [id=b8168282caeb41f1a16e1276d954257c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:32.538020 18451 tablet_service.cc:1467] Processing CreateTablet for tablet 90641add93934d5499d83914f88d1df1 (DEFAULT_TABLE table=test-table [id=b8168282caeb41f1a16e1276d954257c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:32.538000 18744 tablet_service.cc:1467] Processing CreateTablet for tablet 90641add93934d5499d83914f88d1df1 (DEFAULT_TABLE table=test-table [id=b8168282caeb41f1a16e1276d954257c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:32.539815 18744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90641add93934d5499d83914f88d1df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:32.540051 18599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90641add93934d5499d83914f88d1df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:32.540563 18451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90641add93934d5499d83914f88d1df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:32.553224 18842 tablet_bootstrap.cc:492] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Bootstrap starting.
I20260808 02:38:32.558179 18844 tablet_bootstrap.cc:492] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Bootstrap starting.
I20260808 02:38:32.559331 18843 tablet_bootstrap.cc:492] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Bootstrap starting.
I20260808 02:38:32.559780 18842 tablet_bootstrap.cc:654] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:32.561648 18842 log.cc:824] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:32.562893 18844 tablet_bootstrap.cc:654] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:32.563382 18843 tablet_bootstrap.cc:654] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:32.564571 18844 log.cc:824] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:32.564831 18843 log.cc:824] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:32.566036 18842 tablet_bootstrap.cc:492] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: No bootstrap required, opened a new log
I20260808 02:38:32.566429 18842 ts_tablet_manager.cc:1397] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260808 02:38:32.568426 18843 tablet_bootstrap.cc:492] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: No bootstrap required, opened a new log
I20260808 02:38:32.568572 18844 tablet_bootstrap.cc:492] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: No bootstrap required, opened a new log
I20260808 02:38:32.568785 18843 ts_tablet_manager.cc:1397] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 02:38:32.568861 18844 ts_tablet_manager.cc:1397] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260808 02:38:32.578967 18842 raft_consensus.cc:348] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.579651 18842 raft_consensus.cc:374] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:32.579814 18842 raft_consensus.cc:729] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523f229b9d294095a6c9636629613e98, State: Initialized, Role: FOLLOWER
I20260808 02:38:32.580618 18842 consensus_queue.cc:260] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.580566 18844 raft_consensus.cc:348] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.581104 18844 raft_consensus.cc:374] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:32.581285 18844 raft_consensus.cc:729] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Initialized, Role: FOLLOWER
I20260808 02:38:32.582374 18844 consensus_queue.cc:260] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.583009 18843 raft_consensus.cc:348] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.583547 18843 raft_consensus.cc:374] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:32.583688 18843 raft_consensus.cc:729] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934084151eda4cb0a84c5e0dd44e8c04, State: Initialized, Role: FOLLOWER
I20260808 02:38:32.584370 18843 consensus_queue.cc:260] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.586952 18843 ts_tablet_manager.cc:1428] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent starting tablet: real 0.018s user 0.009s sys 0.009s
I20260808 02:38:32.589488 18842 ts_tablet_manager.cc:1428] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Time spent starting tablet: real 0.023s user 0.017s sys 0.006s
I20260808 02:38:32.591590 18844 ts_tablet_manager.cc:1428] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Time spent starting tablet: real 0.023s user 0.013s sys 0.007s
W20260808 02:38:32.631376 18528 tablet.cc:2369] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:38:32.703958 18850 raft_consensus.cc:482] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:32.704566 18850 raft_consensus.cc:504] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.706718 18850 leader_election.cc:288] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033), 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389)
I20260808 02:38:32.716187 18837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.707232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:39673 (local address 127.10.20.67:37033)
0808 02:38:32.707543 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.707550 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.707863 (+ 313us) server_negotiation.cc:407] Connection header received
0808 02:38:32.708171 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.708182 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.708264 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.708370 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.709053 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.709825 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.713178 (+ 3353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.714647 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.714878 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.714977 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.715734 (+ 757us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.715899 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 02:38:32.716187 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.707331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:44911 (local address 127.10.20.66:34389)
0808 02:38:32.707573 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.707580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.708293 (+ 713us) server_negotiation.cc:407] Connection header received
0808 02:38:32.708505 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.708517 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.708592 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.708700 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.709322 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.710123 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.713181 (+ 3058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.714556 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.714942 (+ 386us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.715020 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.715734 (+ 714us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.715963 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 02:38:32.716430 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.707384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34389 (local address 127.10.20.65:44911)
0808 02:38:32.708175 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.708191 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.708360 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.708716 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.708720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.708750 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.709156 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.709166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.710270 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.710277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.712850 (+ 2573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.712876 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.715093 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.715102 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.715399 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.715523 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.715656 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.715989 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":181,"thread_start_us":461,"threads_started":1}
I20260808 02:38:32.716454 18852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.706935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37033 (local address 127.10.20.65:39673)
0808 02:38:32.707725 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.707750 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.708003 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.708390 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.708395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.708421 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.708860 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.708871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.710004 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.710009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.712850 (+ 2841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.712876 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.715103 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.715108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.715404 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.715523 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.715656 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.715912 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":272,"thread_start_us":636,"threads_started":1}
I20260808 02:38:32.717767 18765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90641add93934d5499d83914f88d1df1" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98" is_pre_election: true
I20260808 02:38:32.717792 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90641add93934d5499d83914f88d1df1" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04" is_pre_election: true
I20260808 02:38:32.718457 18621 raft_consensus.cc:2454] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 0.
I20260808 02:38:32.718457 18765 raft_consensus.cc:2454] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 0.
I20260808 02:38:32.719354 18402 leader_election.cc:302] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 523f229b9d294095a6c9636629613e98; no voters:
I20260808 02:38:32.719981 18850 raft_consensus.cc:2781] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:32.720160 18850 raft_consensus.cc:482] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:32.720289 18850 raft_consensus.cc:3037] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:32.722892 18850 raft_consensus.cc:504] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.723658 18850 leader_election.cc:288] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 election: Requested vote from peers 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033), 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389)
I20260808 02:38:32.724418 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90641add93934d5499d83914f88d1df1" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04"
I20260808 02:38:32.724454 18765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90641add93934d5499d83914f88d1df1" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98"
I20260808 02:38:32.724669 18621 raft_consensus.cc:3037] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:32.724741 18765 raft_consensus.cc:3037] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Advancing to term 1
W20260808 02:38:32.726467 18817 tablet.cc:2369] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:38:32.727883 18621 raft_consensus.cc:2454] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 1.
I20260808 02:38:32.728237 18765 raft_consensus.cc:2454] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 1.
I20260808 02:38:32.728688 18400 leader_election.cc:302] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:32.729178 18850 raft_consensus.cc:2781] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:32.729820 18850 raft_consensus.cc:686] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 1 LEADER]: Becoming Leader. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Running, Role: LEADER
I20260808 02:38:32.730428 18850 consensus_queue.cc:237] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } }
I20260808 02:38:32.736727 18309 catalog_manager.cc:5495] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29859a125675468383936fe7a4d4ce47 (127.10.20.65). New cstate: current_term: 1 leader_uuid: "29859a125675468383936fe7a4d4ce47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } health_report { overall_health: HEALTHY } } }
I20260808 02:38:32.780720 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.774309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52920 (local address 127.10.20.65:40047)
0808 02:38:32.774606 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.774612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.774637 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:38:32.774913 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.774919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.775044 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.775216 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:32.775622 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.776340 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.777974 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.778442 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.778568 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.779309 (+ 741us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:32.780089 (+ 780us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:32.780230 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.780391 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.780482 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260808 02:38:32.790548 18765 raft_consensus.cc:1261] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Refusing update from remote peer 29859a125675468383936fe7a4d4ce47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:32.790546 18621 raft_consensus.cc:1261] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Refusing update from remote peer 29859a125675468383936fe7a4d4ce47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:32.791939 18854 consensus_queue.cc:1035] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:32.792536 18850 consensus_queue.cc:1035] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:32.806537 18857 mvcc.cc:205] Tried to move back new op lower bound from 7316097895578406912 to 7316097895349506048. Current Snapshot: MvccSnapshot[applied={T|T < 7316097895578406912}]
I20260808 02:38:32.824407 18310 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:32.824759 18310 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:32.829090 18310 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Sending DeleteTablet for 3 replicas of tablet 90641add93934d5499d83914f88d1df1
I20260808 02:38:32.830641 18451 tablet_service.cc:1514] Processing DeleteTablet for tablet 90641add93934d5499d83914f88d1df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:32 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:52906
I20260808 02:38:32.830724 18744 tablet_service.cc:1514] Processing DeleteTablet for tablet 90641add93934d5499d83914f88d1df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:32 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:43564
I20260808 02:38:32.831879 18599 tablet_service.cc:1514] Processing DeleteTablet for tablet 90641add93934d5499d83914f88d1df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:32 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:40280
I20260808 02:38:32.831981 18310 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:32.832708 18310 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:32.844053 18449 tablet_service.cc:1467] Processing CreateTablet for tablet 07788e1b7bde44618ae7beae8d59a128 (DEFAULT_TABLE table=test-table [id=8905ff8afe4641a3b64f131bdf9de727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:32.844767 18449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07788e1b7bde44618ae7beae8d59a128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:32.845917 18868 tablet_replica.cc:330] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: stopping tablet replica
I20260808 02:38:32.846396 18868 raft_consensus.cc:2229] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:32.847007 18868 raft_consensus.cc:2258] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:32.848018 18869 tablet_replica.cc:330] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: stopping tablet replica
I20260808 02:38:32.848472 18869 raft_consensus.cc:2229] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:32.849296 18869 raft_consensus.cc:2258] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:32.849530 18870 tablet_replica.cc:330] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: stopping tablet replica
I20260808 02:38:32.850015 18870 raft_consensus.cc:2229] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:32.850461 18598 tablet_service.cc:1467] Processing CreateTablet for tablet 07788e1b7bde44618ae7beae8d59a128 (DEFAULT_TABLE table=test-table [id=8905ff8afe4641a3b64f131bdf9de727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:32.850631 18870 raft_consensus.cc:2258] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:32.851212 18598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07788e1b7bde44618ae7beae8d59a128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:32.853718 18870 ts_tablet_manager.cc:1905] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:32.854190 18868 ts_tablet_manager.cc:1905] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:32.855551 18844 tablet_bootstrap.cc:492] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Bootstrap starting.
I20260808 02:38:32.856376 18744 tablet_service.cc:1467] Processing CreateTablet for tablet 07788e1b7bde44618ae7beae8d59a128 (DEFAULT_TABLE table=test-table [id=8905ff8afe4641a3b64f131bdf9de727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:32.857301 18744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07788e1b7bde44618ae7beae8d59a128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:32.857707 18844 tablet_bootstrap.cc:654] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:32.859028 18869 ts_tablet_manager.cc:1905] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:32.865199 18843 tablet_bootstrap.cc:492] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Bootstrap starting.
I20260808 02:38:32.867401 18843 tablet_bootstrap.cc:654] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:32.868016 18869 ts_tablet_manager.cc:1918] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:32.868280 18869 log.cc:1196] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/90641add93934d5499d83914f88d1df1
I20260808 02:38:32.868968 18869 ts_tablet_manager.cc:1939] T 90641add93934d5499d83914f88d1df1 P 29859a125675468383936fe7a4d4ce47: Deleting consensus metadata
I20260808 02:38:32.874715 18868 ts_tablet_manager.cc:1918] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:32.875020 18868 log.cc:1196] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/90641add93934d5499d83914f88d1df1
I20260808 02:38:32.875746 18868 ts_tablet_manager.cc:1939] T 90641add93934d5499d83914f88d1df1 P 523f229b9d294095a6c9636629613e98: Deleting consensus metadata
I20260808 02:38:32.876552 18870 ts_tablet_manager.cc:1918] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:32.876737 18870 log.cc:1196] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/90641add93934d5499d83914f88d1df1
I20260808 02:38:32.877360 18870 ts_tablet_manager.cc:1939] T 90641add93934d5499d83914f88d1df1 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting consensus metadata
I20260808 02:38:32.877440 18844 tablet_bootstrap.cc:492] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: No bootstrap required, opened a new log
I20260808 02:38:32.877646 18844 ts_tablet_manager.cc:1397] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.004s
I20260808 02:38:32.878928 18844 raft_consensus.cc:348] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.879312 18844 raft_consensus.cc:374] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:32.879452 18844 raft_consensus.cc:729] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Initialized, Role: FOLLOWER
I20260808 02:38:32.879518 18294 catalog_manager.cc:4841] TS 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389): tablet 90641add93934d5499d83914f88d1df1 (table test-table [id=b8168282caeb41f1a16e1276d954257c]) successfully deleted
I20260808 02:38:32.879855 18844 consensus_queue.cc:260] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.880352 18294 catalog_manager.cc:4841] TS 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047): tablet 90641add93934d5499d83914f88d1df1 (table test-table [id=b8168282caeb41f1a16e1276d954257c]) successfully deleted
I20260808 02:38:32.880524 18842 tablet_bootstrap.cc:492] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Bootstrap starting.
I20260808 02:38:32.882488 18842 tablet_bootstrap.cc:654] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:32.883553 18844 ts_tablet_manager.cc:1428] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260808 02:38:32.888054 18843 tablet_bootstrap.cc:492] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: No bootstrap required, opened a new log
I20260808 02:38:32.888273 18843 ts_tablet_manager.cc:1397] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.005s
I20260808 02:38:32.889418 18296 catalog_manager.cc:4841] TS 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033): tablet 90641add93934d5499d83914f88d1df1 (table test-table [id=b8168282caeb41f1a16e1276d954257c]) successfully deleted
I20260808 02:38:32.889441 18843 raft_consensus.cc:348] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.889716 18843 raft_consensus.cc:374] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:32.889850 18843 raft_consensus.cc:729] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934084151eda4cb0a84c5e0dd44e8c04, State: Initialized, Role: FOLLOWER
I20260808 02:38:32.890311 18843 consensus_queue.cc:260] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.893422 18843 ts_tablet_manager.cc:1428] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 02:38:32.894784 18842 tablet_bootstrap.cc:492] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: No bootstrap required, opened a new log
I20260808 02:38:32.895038 18842 ts_tablet_manager.cc:1397] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.006s
I20260808 02:38:32.895982 18842 raft_consensus.cc:348] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.896229 18842 raft_consensus.cc:374] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:32.896304 18842 raft_consensus.cc:729] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523f229b9d294095a6c9636629613e98, State: Initialized, Role: FOLLOWER
I20260808 02:38:32.896660 18842 consensus_queue.cc:260] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.897854 18842 ts_tablet_manager.cc:1428] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 02:38:32.964419 18848 raft_consensus.cc:482] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:32.964740 18848 raft_consensus.cc:504] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.966969 18848 leader_election.cc:288] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047), 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389)
I20260808 02:38:32.976192 18875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.967359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:40047 (local address 127.10.20.67:55533)
0808 02:38:32.968257 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.968282 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.968440 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.969070 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.969076 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.969111 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.969690 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.969707 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.971346 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.971351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.973176 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.973195 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.975139 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.975147 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.975345 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.975390 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.975527 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.975699 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":1,"thread_start_us":536,"threads_started":1}
I20260808 02:38:32.976193 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.967389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:55533 (local address 127.10.20.65:40047)
0808 02:38:32.967663 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.967674 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.968500 (+ 826us) server_negotiation.cc:407] Connection header received
0808 02:38:32.968626 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.968647 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.968741 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.968852 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.969921 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.971190 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.973388 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.974875 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.975082 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.975170 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.975564 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.975717 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 02:38:32.976889 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.968873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:43393 (local address 127.10.20.66:34389)
0808 02:38:32.969131 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:32.969139 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:32.970043 (+ 904us) server_negotiation.cc:407] Connection header received
0808 02:38:32.970221 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:32.970226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:32.970307 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:32.970408 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:32.971093 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.972243 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.974298 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.975468 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.975641 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.975708 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:32.976411 (+ 703us) server_negotiation.cc:299] Negotiation successful
0808 02:38:32.976592 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 02:38:32.977736 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:32.968468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34389 (local address 127.10.20.67:43393)
0808 02:38:32.969897 (+ 1429us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:32.969918 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:32.970078 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:32.970462 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:32.970467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:32.970498 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:32.970881 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.970893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.972411 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.972417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.974100 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:32.974114 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:32.975887 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:32.975894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:32.976118 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:32.976172 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 02:38:32.976956 (+ 784us) client_negotiation.cc:240] Negotiation successful
0808 02:38:32.977364 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1276,"thread_start_us":1001,"threads_started":1}
I20260808 02:38:32.977923 18473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07788e1b7bde44618ae7beae8d59a128" candidate_uuid: "523f229b9d294095a6c9636629613e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29859a125675468383936fe7a4d4ce47" is_pre_election: true
I20260808 02:38:32.978435 18473 raft_consensus.cc:2454] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523f229b9d294095a6c9636629613e98 in term 0.
I20260808 02:38:32.978431 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07788e1b7bde44618ae7beae8d59a128" candidate_uuid: "523f229b9d294095a6c9636629613e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04" is_pre_election: true
I20260808 02:38:32.978713 18621 raft_consensus.cc:2454] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523f229b9d294095a6c9636629613e98 in term 0.
I20260808 02:38:32.979305 18693 leader_election.cc:302] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523f229b9d294095a6c9636629613e98, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:32.979830 18848 raft_consensus.cc:2781] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:32.980142 18848 raft_consensus.cc:482] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:32.980369 18848 raft_consensus.cc:3037] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:32.983611 18848 raft_consensus.cc:504] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.984639 18848 leader_election.cc:288] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [CANDIDATE]: Term 1 election: Requested vote from peers 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047), 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389)
I20260808 02:38:32.985304 18473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07788e1b7bde44618ae7beae8d59a128" candidate_uuid: "523f229b9d294095a6c9636629613e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29859a125675468383936fe7a4d4ce47"
I20260808 02:38:32.985386 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07788e1b7bde44618ae7beae8d59a128" candidate_uuid: "523f229b9d294095a6c9636629613e98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04"
I20260808 02:38:32.985607 18473 raft_consensus.cc:3037] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:32.985680 18621 raft_consensus.cc:3037] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:32.988462 18473 raft_consensus.cc:2454] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523f229b9d294095a6c9636629613e98 in term 1.
I20260808 02:38:32.989078 18693 leader_election.cc:302] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 523f229b9d294095a6c9636629613e98; no voters:
I20260808 02:38:32.989404 18621 raft_consensus.cc:2454] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523f229b9d294095a6c9636629613e98 in term 1.
I20260808 02:38:32.989477 18848 raft_consensus.cc:2781] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:32.990479 18848 raft_consensus.cc:686] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 1 LEADER]: Becoming Leader. State: Replica: 523f229b9d294095a6c9636629613e98, State: Running, Role: LEADER
I20260808 02:38:32.991276 18848 consensus_queue.cc:237] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:32.995944 18309 catalog_manager.cc:5495] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523f229b9d294095a6c9636629613e98 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "523f229b9d294095a6c9636629613e98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } health_report { overall_health: HEALTHY } } }
Aug 08 02:38:33 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156708, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.126@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:33.070428 18884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.053720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:35493 (local address 127.0.0.1:34854)
0808 02:38:33.054598 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:33.054634 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:33.054894 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:33.055351 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:33.055356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:33.056229 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:33.056443 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.056454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.057835 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.057841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.059256 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.059273 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.060084 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.060090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.060341 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.061134 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:33.061153 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:33.063686 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:33.067247 (+ 3561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:33.067268 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:33.067276 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:33.067829 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:33.068429 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:33.068439 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:33.068441 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:33.068594 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:33.069223 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:33.069233 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:33.069432 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 02:38:33.069607 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 02:38:33.069955 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":46,"thread_start_us":466,"threads_started":1}
I20260808 02:38:33.070449 18885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.053773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.10.20.126:35493)
0808 02:38:33.055042 (+ 1269us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.055047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.055066 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:38:33.055115 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.055119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.055187 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.055325 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:33.056612 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.057686 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.059413 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.059887 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.060131 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.063964 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:33.063970 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:33.063974 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:33.064010 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:33.067067 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:33.068078 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:33.068091 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:33.068094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:33.068232 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:33.068741 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:33.068745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:33.068747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:33.069063 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:33.069239 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.069713 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.070091 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":173,"server-negotiator.queue_time_us":1149,"thread_start_us":985,"threads_started":1}
I20260808 02:38:33.077466 18309 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:34854:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 02:38:33.077950 18673 tablet.cc:2369] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:38:33.079068 18309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:33.089112 18449 tablet_service.cc:1467] Processing CreateTablet for tablet bff0af4822a04c71aa91c65dd1a2492e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8b85b39e720c4b80abe073b399f9896f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:38:33.089344 18744 tablet_service.cc:1467] Processing CreateTablet for tablet bff0af4822a04c71aa91c65dd1a2492e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8b85b39e720c4b80abe073b399f9896f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:38:33.089877 18449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bff0af4822a04c71aa91c65dd1a2492e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:33.089885 18744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bff0af4822a04c71aa91c65dd1a2492e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:33.091919 18598 tablet_service.cc:1467] Processing CreateTablet for tablet bff0af4822a04c71aa91c65dd1a2492e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8b85b39e720c4b80abe073b399f9896f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 02:38:33.092549 18598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bff0af4822a04c71aa91c65dd1a2492e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:33.098352 18842 tablet_bootstrap.cc:492] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: Bootstrap starting.
I20260808 02:38:33.100369 18842 tablet_bootstrap.cc:654] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:33.101744 18844 tablet_bootstrap.cc:492] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: Bootstrap starting.
I20260808 02:38:33.103004 18842 tablet_bootstrap.cc:492] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: No bootstrap required, opened a new log
I20260808 02:38:33.103211 18842 ts_tablet_manager.cc:1397] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 02:38:33.103760 18844 tablet_bootstrap.cc:654] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:33.104159 18842 raft_consensus.cc:348] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.104441 18842 raft_consensus.cc:374] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:33.104558 18842 raft_consensus.cc:729] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523f229b9d294095a6c9636629613e98, State: Initialized, Role: FOLLOWER
I20260808 02:38:33.104847 18842 consensus_queue.cc:260] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.105326 18848 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.105576 18842 ts_tablet_manager.cc:1428] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 02:38:33.105666 18848 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.109588 18843 tablet_bootstrap.cc:492] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: Bootstrap starting.
I20260808 02:38:33.111506 18843 tablet_bootstrap.cc:654] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:33.115132 18843 tablet_bootstrap.cc:492] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: No bootstrap required, opened a new log
I20260808 02:38:33.115314 18844 tablet_bootstrap.cc:492] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: No bootstrap required, opened a new log
I20260808 02:38:33.115340 18843 ts_tablet_manager.cc:1397] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 02:38:33.115512 18844 ts_tablet_manager.cc:1397] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.003s
I20260808 02:38:33.116216 18843 raft_consensus.cc:348] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.116304 18844 raft_consensus.cc:348] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.116497 18843 raft_consensus.cc:374] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:33.116573 18843 raft_consensus.cc:729] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934084151eda4cb0a84c5e0dd44e8c04, State: Initialized, Role: FOLLOWER
I20260808 02:38:33.116590 18844 raft_consensus.cc:374] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:33.116676 18844 raft_consensus.cc:729] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Initialized, Role: FOLLOWER
I20260808 02:38:33.116847 18843 consensus_queue.cc:260] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.116943 18844 consensus_queue.cc:260] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.117561 18863 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.118175 18863 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.118347 18844 ts_tablet_manager.cc:1428] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 02:38:33.118894 18843 ts_tablet_manager.cc:1428] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 02:38:33.117914 18851 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.119485 18851 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.294100 18851 raft_consensus.cc:482] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:33.294385 18851 raft_consensus.cc:504] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.296569 18851 leader_election.cc:288] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047), 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:33.316816 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.297128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:37667 (local address 127.10.20.67:37033)
0808 02:38:33.309122 (+ 11994us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.309129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.309153 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:38:33.309238 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.309244 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.309331 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.309511 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:33.310048 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.311275 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.314565 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.315583 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.315827 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.315908 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.316330 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.316506 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11853,"thread_start_us":11745,"threads_started":1}
I20260808 02:38:33.316874 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.297050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37033 (local address 127.10.20.66:37667)
0808 02:38:33.308101 (+ 11051us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:33.308130 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:33.308329 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:33.309526 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:33.309531 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:33.309560 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:33.309880 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.309889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.311462 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.311468 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.314264 (+ 2796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.314289 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.315849 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.315856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.316097 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.316147 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 02:38:33.316259 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 02:38:33.316438 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10840,"mutex_wait_us":133,"thread_start_us":11514,"threads_started":1}
I20260808 02:38:33.317036 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.297600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:46053 (local address 127.10.20.65:40047)
0808 02:38:33.297795 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.297802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.309015 (+ 11213us) server_negotiation.cc:407] Connection header received
0808 02:38:33.309284 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.309289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.309367 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.309504 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:38:33.310490 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.311483 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.314530 (+ 3047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.315899 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.316089 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.316160 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.316555 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.316733 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:38:33.318081 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.297169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:40047 (local address 127.10.20.66:46053)
0808 02:38:33.308872 (+ 11703us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:33.308894 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:33.309110 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:33.310018 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:33.310021 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:33.310041 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:38:33.310313 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.310320 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.311713 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.311724 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.314264 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.314289 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.316166 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.316172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.316360 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.316392 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:38:33.317446 (+ 1054us) client_negotiation.cc:240] Negotiation successful
0808 02:38:33.317626 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11542,"mutex_wait_us":51,"thread_start_us":10529,"threads_started":1}
I20260808 02:38:33.318038 18765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff0af4822a04c71aa91c65dd1a2492e" candidate_uuid: "934084151eda4cb0a84c5e0dd44e8c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98" is_pre_election: true
I20260808 02:38:33.318313 18765 raft_consensus.cc:2454] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 934084151eda4cb0a84c5e0dd44e8c04 in term 0.
I20260808 02:38:33.318836 18473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff0af4822a04c71aa91c65dd1a2492e" candidate_uuid: "934084151eda4cb0a84c5e0dd44e8c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29859a125675468383936fe7a4d4ce47" is_pre_election: true
I20260808 02:38:33.318886 18550 leader_election.cc:302] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523f229b9d294095a6c9636629613e98, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:33.319101 18473 raft_consensus.cc:2454] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 934084151eda4cb0a84c5e0dd44e8c04 in term 0.
I20260808 02:38:33.319381 18851 raft_consensus.cc:2781] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:33.319577 18851 raft_consensus.cc:482] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:33.319718 18851 raft_consensus.cc:3037] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:33.322057 18851 raft_consensus.cc:504] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.323078 18851 leader_election.cc:288] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [CANDIDATE]: Term 1 election: Requested vote from peers 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047), 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:33.323894 18765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff0af4822a04c71aa91c65dd1a2492e" candidate_uuid: "934084151eda4cb0a84c5e0dd44e8c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98"
I20260808 02:38:33.323966 18473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff0af4822a04c71aa91c65dd1a2492e" candidate_uuid: "934084151eda4cb0a84c5e0dd44e8c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29859a125675468383936fe7a4d4ce47"
I20260808 02:38:33.324178 18765 raft_consensus.cc:3037] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:33.324278 18473 raft_consensus.cc:3037] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:33.326800 18765 raft_consensus.cc:2454] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 934084151eda4cb0a84c5e0dd44e8c04 in term 1.
I20260808 02:38:33.327430 18550 leader_election.cc:302] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523f229b9d294095a6c9636629613e98, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:33.327791 18851 raft_consensus.cc:2781] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:33.328096 18473 raft_consensus.cc:2454] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 934084151eda4cb0a84c5e0dd44e8c04 in term 1.
I20260808 02:38:33.328392 18851 raft_consensus.cc:686] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 LEADER]: Becoming Leader. State: Replica: 934084151eda4cb0a84c5e0dd44e8c04, State: Running, Role: LEADER
I20260808 02:38:33.329156 18851 consensus_queue.cc:237] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.331492 18893 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: TxnStatusTablet state changed. Reason: New leader 934084151eda4cb0a84c5e0dd44e8c04. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.331954 18893 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:38:33.332887 18895 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 02:38:33.333173 18895 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 02:38:33.333851 18309 catalog_manager.cc:5495] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66). New cstate: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } health_report { overall_health: UNKNOWN } } }
I20260808 02:38:33.359874 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.350200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.10.20.66:34389)
0808 02:38:33.350428 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.350435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.350754 (+ 319us) server_negotiation.cc:407] Connection header received
0808 02:38:33.351140 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.351152 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.351283 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.351473 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:33.351959 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.353342 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.355801 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.356651 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.356826 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.357694 (+ 868us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.358819 (+ 1125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.359012 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.359358 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.359482 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:38:33.360235 18884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.350128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34389 (local address 127.0.0.1:40288)
0808 02:38:33.350599 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:33.350624 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:33.350857 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:33.351532 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:33.351539 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:33.351555 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:38:33.351784 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.351797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.353581 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.353589 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.355576 (+ 1987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.355602 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.356894 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.356902 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.357246 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.357357 (+ 111us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.359140 (+ 1783us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.359186 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:38:33.359295 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 02:38:33.359569 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270}
I20260808 02:38:33.366797 18765 raft_consensus.cc:1261] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Refusing update from remote peer 934084151eda4cb0a84c5e0dd44e8c04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:33.367180 18473 raft_consensus.cc:1261] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Refusing update from remote peer 934084151eda4cb0a84c5e0dd44e8c04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:33.367885 18893 consensus_queue.cc:1035] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:33.368410 18851 consensus_queue.cc:1035] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:33.381320 18877 consensus_queue.cc:1035] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:33.391539 18899 mvcc.cc:205] Tried to move back new op lower bound from 7316097897941155840 to 7316097897800544256. Current Snapshot: MvccSnapshot[applied={T|T < 7316097897941155840}]
I20260808 02:38:33.394114 18898 mvcc.cc:205] Tried to move back new op lower bound from 7316097897941155840 to 7316097897800544256. Current Snapshot: MvccSnapshot[applied={T|T < 7316097897941155840}]
I20260808 02:38:33.395227 18893 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.395579 18893 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:38:33.398433 18848 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: TxnStatusTablet state changed. Reason: New leader 934084151eda4cb0a84c5e0dd44e8c04. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.398900 18848 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.399121 18877 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.399500 18877 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 523f229b9d294095a6c9636629613e98: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.404583 18863 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: TxnStatusTablet state changed. Reason: New leader 934084151eda4cb0a84c5e0dd44e8c04. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.405009 18863 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.408478 18851 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.408836 18851 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 934084151eda4cb0a84c5e0dd44e8c04: This TxnStatusTablet replica's current role is: LEADER
I20260808 02:38:33.422783 18848 consensus_queue.cc:1035] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:33.427896 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.410157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43570 (local address 127.10.20.67:37033)
0808 02:38:33.410406 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.410417 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.418264 (+ 7847us) server_negotiation.cc:407] Connection header received
0808 02:38:33.418779 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.418787 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.418926 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.419095 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:33.419975 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.421389 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.424281 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.425118 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.425239 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.426105 (+ 866us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.426997 (+ 892us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.427128 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.427454 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.427565 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 02:38:33.430474 18863 tablet_replica.cc:439] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "934084151eda4cb0a84c5e0dd44e8c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } } }
I20260808 02:38:33.430969 18863 tablet_replica.cc:442] T bff0af4822a04c71aa91c65dd1a2492e P 29859a125675468383936fe7a4d4ce47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 02:38:33.454396 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.445401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:38695 (local address 127.10.20.66:34389)
0808 02:38:33.445658 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.445668 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.447020 (+ 1352us) server_negotiation.cc:407] Connection header received
0808 02:38:33.447122 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.447129 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.447233 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.447314 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:33.448087 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.449025 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.451890 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.452511 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.452650 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.453424 (+ 774us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.453566 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.453668 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.454009 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.454111 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 02:38:33.454548 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.445406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34389 (local address 127.10.20.67:38695)
0808 02:38:33.446591 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:33.446617 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:33.446845 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:33.447385 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:33.447391 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:33.447425 (+ 34us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:38:33.447848 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.447865 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.449232 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.449239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.451577 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.451607 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.452775 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.452784 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.453007 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.453130 (+ 123us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.453710 (+ 580us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.453724 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 02:38:33.453818 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 02:38:33.454017 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"thread_start_us":439,"threads_started":1}
I20260808 02:38:33.514308 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.502636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:57293 (local address 127.10.20.67:37033)
0808 02:38:33.502946 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.502955 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.505131 (+ 2176us) server_negotiation.cc:407] Connection header received
0808 02:38:33.505679 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.505685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.505796 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.506101 (+ 305us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:33.507491 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.508857 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.511701 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.512404 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.512593 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.513275 (+ 682us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.513466 (+ 191us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.513576 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.513826 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.513935 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260808 02:38:33.514760 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.502650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37033 (local address 127.10.20.66:57293)
0808 02:38:33.504876 (+ 2226us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:33.504897 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:33.505439 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:33.506539 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:33.506545 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:33.506567 (+ 22us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:38:33.507187 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.507207 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.509217 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.509223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.511452 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:33.511481 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.512681 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.512690 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:33.512904 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.513003 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.513647 (+ 644us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.513659 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 02:38:33.513779 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 02:38:33.513993 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1959,"thread_start_us":1379,"threads_started":1}
I20260808 02:38:33.563246 18308 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:33.563567 18308 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:33.568126 18308 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Sending DeleteTablet for 3 replicas of tablet 07788e1b7bde44618ae7beae8d59a128
I20260808 02:38:33.569255 18744 tablet_service.cc:1514] Processing DeleteTablet for tablet 07788e1b7bde44618ae7beae8d59a128 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:33 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:43564
I20260808 02:38:33.569268 18449 tablet_service.cc:1514] Processing DeleteTablet for tablet 07788e1b7bde44618ae7beae8d59a128 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:33 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:52906
I20260808 02:38:33.570573 18598 tablet_service.cc:1514] Processing DeleteTablet for tablet 07788e1b7bde44618ae7beae8d59a128 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:33 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:40280
I20260808 02:38:33.596271 18921 tablet_replica.cc:330] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: stopping tablet replica
I20260808 02:38:33.598963 18921 raft_consensus.cc:2229] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:33.599896 18921 raft_consensus.cc:2258] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:33.600135 18922 tablet_replica.cc:330] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: stopping tablet replica
I20260808 02:38:33.600580 18922 raft_consensus.cc:2229] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:33.600982 18922 raft_consensus.cc:2258] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:33.601752 18920 tablet_replica.cc:330] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: stopping tablet replica
I20260808 02:38:33.602018 18920 raft_consensus.cc:2229] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:33.602777 18920 raft_consensus.cc:2258] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:33.604619 18920 ts_tablet_manager.cc:1905] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:33.602864 18921 ts_tablet_manager.cc:1905] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:33.608354 18922 ts_tablet_manager.cc:1905] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:33.621336 18921 ts_tablet_manager.cc:1918] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:38:33.625926 18922 ts_tablet_manager.cc:1918] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:38:33.626166 18922 log.cc:1196] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/07788e1b7bde44618ae7beae8d59a128
I20260808 02:38:33.626405 18921 log.cc:1196] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/07788e1b7bde44618ae7beae8d59a128
I20260808 02:38:33.626812 18922 ts_tablet_manager.cc:1939] T 07788e1b7bde44618ae7beae8d59a128 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting consensus metadata
I20260808 02:38:33.627255 18921 ts_tablet_manager.cc:1939] T 07788e1b7bde44618ae7beae8d59a128 P 523f229b9d294095a6c9636629613e98: Deleting consensus metadata
I20260808 02:38:33.628427 18294 catalog_manager.cc:4841] TS 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389): tablet 07788e1b7bde44618ae7beae8d59a128 (table test-table [id=8905ff8afe4641a3b64f131bdf9de727]) successfully deleted
I20260808 02:38:33.628901 18296 catalog_manager.cc:4841] TS 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033): tablet 07788e1b7bde44618ae7beae8d59a128 (table test-table [id=8905ff8afe4641a3b64f131bdf9de727]) successfully deleted
I20260808 02:38:33.629699 18920 ts_tablet_manager.cc:1918] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:38:33.630218 18920 log.cc:1196] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/07788e1b7bde44618ae7beae8d59a128
I20260808 02:38:33.630913 18920 ts_tablet_manager.cc:1939] T 07788e1b7bde44618ae7beae8d59a128 P 29859a125675468383936fe7a4d4ce47: Deleting consensus metadata
I20260808 02:38:33.632354 18294 catalog_manager.cc:4841] TS 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047): tablet 07788e1b7bde44618ae7beae8d59a128 (table test-table [id=8905ff8afe4641a3b64f131bdf9de727]) successfully deleted
Aug 08 02:38:33 dist-test-slave-8tdl krb5kdc[18261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260808 02:38:33.701817 10321 mini_kdc.cc:317] Time spent kinit for test-admin: real 0.119s user 0.004s sys 0.028s
Aug 08 02:38:33 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:33 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:38:33.740592 18929 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:33.706207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34862 (local address 127.10.20.126:35493)
0808 02:38:33.722214 (+ 16007us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.722223 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.723551 (+ 1328us) server_negotiation.cc:407] Connection header received
0808 02:38:33.723638 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.723645 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.723739 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.723851 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:33.726888 (+ 3037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.728173 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.730501 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.731085 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.731261 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.739888 (+ 8627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34862: BlockingRecv error: recv got EOF from 127.0.0.1:34862 (error 108)
Metrics: {"server-negotiator.queue_time_us":15806,"thread_start_us":17168,"threads_started":1}
Aug 08 02:38:33 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM
I20260808 02:38:33.763190 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.745191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34878 (local address 127.10.20.126:35493)
0808 02:38:33.745527 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.745539 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.746058 (+ 519us) server_negotiation.cc:407] Connection header received
0808 02:38:33.746292 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.746299 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.746390 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.746506 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:33.748056 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.749293 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.750789 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.751288 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.751452 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.756553 (+ 5101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:33.756560 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:33.756563 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:33.756610 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:33.759986 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:33.760890 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:33.760895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:33.760898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:33.761057 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:33.761505 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:33.761514 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:33.761517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:33.761825 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:33.762116 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.762460 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.762762 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260808 02:38:33.767989 18308 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:33.768723 18308 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:33.777194 18598 tablet_service.cc:1467] Processing CreateTablet for tablet bfd93064a26f4f1baa412c66157df2f8 (DEFAULT_TABLE table=test-table [id=be7d1203ddee4c35b6e2dc20789ba312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:33.777184 18449 tablet_service.cc:1467] Processing CreateTablet for tablet bfd93064a26f4f1baa412c66157df2f8 (DEFAULT_TABLE table=test-table [id=be7d1203ddee4c35b6e2dc20789ba312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:33.777776 18449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfd93064a26f4f1baa412c66157df2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:33.777788 18598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfd93064a26f4f1baa412c66157df2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:33.788107 18744 tablet_service.cc:1467] Processing CreateTablet for tablet bfd93064a26f4f1baa412c66157df2f8 (DEFAULT_TABLE table=test-table [id=be7d1203ddee4c35b6e2dc20789ba312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:33.788734 18744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfd93064a26f4f1baa412c66157df2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:33.794090 18936 tablet_bootstrap.cc:492] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Bootstrap starting.
I20260808 02:38:33.796213 18937 tablet_bootstrap.cc:492] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Bootstrap starting.
I20260808 02:38:33.797991 18936 tablet_bootstrap.cc:654] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:33.800724 18937 tablet_bootstrap.cc:654] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:33.807789 18936 tablet_bootstrap.cc:492] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: No bootstrap required, opened a new log
I20260808 02:38:33.808244 18936 ts_tablet_manager.cc:1397] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260808 02:38:33.809345 18936 raft_consensus.cc:348] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.809816 18936 raft_consensus.cc:374] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:33.810009 18936 raft_consensus.cc:729] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Initialized, Role: FOLLOWER
I20260808 02:38:33.810534 18936 consensus_queue.cc:260] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.815361 18938 tablet_bootstrap.cc:492] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Bootstrap starting.
I20260808 02:38:33.816576 18936 ts_tablet_manager.cc:1428] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260808 02:38:33.818126 18938 tablet_bootstrap.cc:654] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:33.818284 18937 tablet_bootstrap.cc:492] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: No bootstrap required, opened a new log
I20260808 02:38:33.818480 18937 ts_tablet_manager.cc:1397] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.006s
I20260808 02:38:33.820385 18937 raft_consensus.cc:348] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.820834 18937 raft_consensus.cc:374] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:33.820981 18937 raft_consensus.cc:729] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934084151eda4cb0a84c5e0dd44e8c04, State: Initialized, Role: FOLLOWER
I20260808 02:38:33.821300 18937 consensus_queue.cc:260] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.822189 18937 ts_tablet_manager.cc:1428] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260808 02:38:33.825146 18938 tablet_bootstrap.cc:492] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: No bootstrap required, opened a new log
I20260808 02:38:33.825356 18938 ts_tablet_manager.cc:1397] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:38:33.826282 18938 raft_consensus.cc:348] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.826630 18938 raft_consensus.cc:374] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:33.826761 18938 raft_consensus.cc:729] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523f229b9d294095a6c9636629613e98, State: Initialized, Role: FOLLOWER
I20260808 02:38:33.827075 18938 consensus_queue.cc:260] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.830300 18938 ts_tablet_manager.cc:1428] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 02:38:33.873662 18863 raft_consensus.cc:482] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:33.873931 18863 raft_consensus.cc:504] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.875069 18863 leader_election.cc:288] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389), 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:33.875990 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfd93064a26f4f1baa412c66157df2f8" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04" is_pre_election: true
I20260808 02:38:33.876328 18621 raft_consensus.cc:2454] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 0.
I20260808 02:38:33.876955 18400 leader_election.cc:302] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:33.877954 18764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfd93064a26f4f1baa412c66157df2f8" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98" is_pre_election: true
I20260808 02:38:33.878587 18764 raft_consensus.cc:2454] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 0.
I20260808 02:38:33.880126 18863 raft_consensus.cc:2781] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:33.880295 18863 raft_consensus.cc:482] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:33.880398 18863 raft_consensus.cc:3037] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:33.886381 18863 raft_consensus.cc:504] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.887949 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfd93064a26f4f1baa412c66157df2f8" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04"
I20260808 02:38:33.888293 18621 raft_consensus.cc:3037] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:33.892278 18621 raft_consensus.cc:2454] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 1.
I20260808 02:38:33.893015 18400 leader_election.cc:302] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:33.893442 18902 raft_consensus.cc:2781] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:33.898581 18764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfd93064a26f4f1baa412c66157df2f8" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98"
I20260808 02:38:33.898922 18764 raft_consensus.cc:3037] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:33.902776 18764 raft_consensus.cc:2454] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 1.
I20260808 02:38:33.905536 18863 leader_election.cc:288] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 election: Requested vote from peers 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389), 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:33.912545 18902 raft_consensus.cc:686] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 1 LEADER]: Becoming Leader. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Running, Role: LEADER
I20260808 02:38:33.913074 18902 consensus_queue.cc:237] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:33.917965 18310 catalog_manager.cc:5495] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29859a125675468383936fe7a4d4ce47 (127.10.20.65). New cstate: current_term: 1 leader_uuid: "29859a125675468383936fe7a4d4ce47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } health_report { overall_health: UNKNOWN } } }
I20260808 02:38:33.945973 18948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:33.937097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52926 (local address 127.10.20.65:40047)
0808 02:38:33.937824 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:33.937833 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:33.937855 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:38:33.937936 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:33.937941 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:33.938061 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:33.938175 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:33.938762 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.940073 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.942754 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:33.943724 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:33.943932 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:33.944731 (+ 799us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:33.945086 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:33.945212 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:33.945442 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 02:38:33.945550 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":382,"threads_started":1}
I20260808 02:38:33.950416 18621 raft_consensus.cc:1261] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Refusing update from remote peer 29859a125675468383936fe7a4d4ce47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:33.950476 18764 raft_consensus.cc:1261] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Refusing update from remote peer 29859a125675468383936fe7a4d4ce47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:33.951422 18944 consensus_queue.cc:1035] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:33.952054 18902 consensus_queue.cc:1035] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:33.985306 18310 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:33.985672 18310 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:33.989902 18310 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Sending DeleteTablet for 3 replicas of tablet bfd93064a26f4f1baa412c66157df2f8
I20260808 02:38:33.991055 18449 tablet_service.cc:1514] Processing DeleteTablet for tablet bfd93064a26f4f1baa412c66157df2f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:33 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:52906
I20260808 02:38:33.991047 18744 tablet_service.cc:1514] Processing DeleteTablet for tablet bfd93064a26f4f1baa412c66157df2f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:33 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:43564
I20260808 02:38:33.991401 18921 tablet_replica.cc:330] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: stopping tablet replica
I20260808 02:38:33.991426 18920 tablet_replica.cc:330] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: stopping tablet replica
I20260808 02:38:33.991649 18920 raft_consensus.cc:2229] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:33.991670 18921 raft_consensus.cc:2229] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:33.991943 18921 raft_consensus.cc:2258] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:33.991917 18598 tablet_service.cc:1514] Processing DeleteTablet for tablet bfd93064a26f4f1baa412c66157df2f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:33 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:40280
I20260808 02:38:33.992062 18920 raft_consensus.cc:2258] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:33.992444 18922 tablet_replica.cc:330] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: stopping tablet replica
I20260808 02:38:33.992657 18922 raft_consensus.cc:2229] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:33.992929 18922 raft_consensus.cc:2258] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:33.994001 18922 ts_tablet_manager.cc:1905] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:33.995417 18921 ts_tablet_manager.cc:1905] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:33.996688 18920 ts_tablet_manager.cc:1905] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:34.011154 18310 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:38:34.012210 18310 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:38:34.013923 18921 ts_tablet_manager.cc:1918] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:34.014153 18921 log.cc:1196] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/bfd93064a26f4f1baa412c66157df2f8
I20260808 02:38:34.016381 18921 ts_tablet_manager.cc:1939] T bfd93064a26f4f1baa412c66157df2f8 P 523f229b9d294095a6c9636629613e98: Deleting consensus metadata
I20260808 02:38:34.017794 18920 ts_tablet_manager.cc:1918] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:34.018319 18920 log.cc:1196] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/bfd93064a26f4f1baa412c66157df2f8
I20260808 02:38:34.018970 18920 ts_tablet_manager.cc:1939] T bfd93064a26f4f1baa412c66157df2f8 P 29859a125675468383936fe7a4d4ce47: Deleting consensus metadata
I20260808 02:38:34.024987 18744 tablet_service.cc:1467] Processing CreateTablet for tablet e52bf61f636040d5960eb856951e9e10 (DEFAULT_TABLE table=test-table [id=84fb73aceb2e4f0488229e29ac6270af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:34.025353 18449 tablet_service.cc:1467] Processing CreateTablet for tablet e52bf61f636040d5960eb856951e9e10 (DEFAULT_TABLE table=test-table [id=84fb73aceb2e4f0488229e29ac6270af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:34.025861 18449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e52bf61f636040d5960eb856951e9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:34.026773 18598 tablet_service.cc:1467] Processing CreateTablet for tablet e52bf61f636040d5960eb856951e9e10 (DEFAULT_TABLE table=test-table [id=84fb73aceb2e4f0488229e29ac6270af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:38:34.027048 18922 ts_tablet_manager.cc:1918] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:38:34.027261 18922 log.cc:1196] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/bfd93064a26f4f1baa412c66157df2f8
I20260808 02:38:34.027328 18598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e52bf61f636040d5960eb856951e9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:34.027856 18922 ts_tablet_manager.cc:1939] T bfd93064a26f4f1baa412c66157df2f8 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting consensus metadata
I20260808 02:38:34.030879 18294 catalog_manager.cc:4841] TS 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047): tablet bfd93064a26f4f1baa412c66157df2f8 (table test-table [id=be7d1203ddee4c35b6e2dc20789ba312]) successfully deleted
I20260808 02:38:34.031388 18294 catalog_manager.cc:4841] TS 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389): tablet bfd93064a26f4f1baa412c66157df2f8 (table test-table [id=be7d1203ddee4c35b6e2dc20789ba312]) successfully deleted
I20260808 02:38:34.042302 18937 tablet_bootstrap.cc:492] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Bootstrap starting.
I20260808 02:38:34.044387 18936 tablet_bootstrap.cc:492] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Bootstrap starting.
I20260808 02:38:34.044571 18937 tablet_bootstrap.cc:654] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:34.046285 18936 tablet_bootstrap.cc:654] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:34.052445 18744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e52bf61f636040d5960eb856951e9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:34.057721 18937 tablet_bootstrap.cc:492] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: No bootstrap required, opened a new log
I20260808 02:38:34.058012 18937 ts_tablet_manager.cc:1397] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.005s
I20260808 02:38:34.058974 18937 raft_consensus.cc:348] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.059312 18937 raft_consensus.cc:374] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:34.059407 18937 raft_consensus.cc:729] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934084151eda4cb0a84c5e0dd44e8c04, State: Initialized, Role: FOLLOWER
I20260808 02:38:34.059715 18937 consensus_queue.cc:260] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.060484 18937 ts_tablet_manager.cc:1428] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 02:38:34.061517 18938 tablet_bootstrap.cc:492] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Bootstrap starting.
I20260808 02:38:34.063169 18296 catalog_manager.cc:4841] TS 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033): tablet bfd93064a26f4f1baa412c66157df2f8 (table test-table [id=be7d1203ddee4c35b6e2dc20789ba312]) successfully deleted
I20260808 02:38:34.063818 18938 tablet_bootstrap.cc:654] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:34.070976 18936 tablet_bootstrap.cc:492] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: No bootstrap required, opened a new log
I20260808 02:38:34.071254 18936 ts_tablet_manager.cc:1397] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.000s
I20260808 02:38:34.072208 18936 raft_consensus.cc:348] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.072494 18936 raft_consensus.cc:374] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:34.072614 18936 raft_consensus.cc:729] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Initialized, Role: FOLLOWER
I20260808 02:38:34.073081 18938 tablet_bootstrap.cc:492] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: No bootstrap required, opened a new log
I20260808 02:38:34.073324 18938 ts_tablet_manager.cc:1397] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260808 02:38:34.073904 18936 consensus_queue.cc:260] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.074332 18938 raft_consensus.cc:348] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.074653 18938 raft_consensus.cc:374] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:34.074827 18938 raft_consensus.cc:729] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523f229b9d294095a6c9636629613e98, State: Initialized, Role: FOLLOWER
I20260808 02:38:34.075201 18938 consensus_queue.cc:260] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.077481 18936 ts_tablet_manager.cc:1428] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260808 02:38:34.078627 18938 ts_tablet_manager.cc:1428] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260808 02:38:34.295044 18944 raft_consensus.cc:482] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:38:34.295365 18944 raft_consensus.cc:504] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.296115 18944 leader_election.cc:288] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389), 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:34.296938 18764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52bf61f636040d5960eb856951e9e10" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98" is_pre_election: true
I20260808 02:38:34.296931 18620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52bf61f636040d5960eb856951e9e10" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04" is_pre_election: true
I20260808 02:38:34.297214 18764 raft_consensus.cc:2454] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 0.
I20260808 02:38:34.297214 18620 raft_consensus.cc:2454] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 0.
I20260808 02:38:34.297775 18402 leader_election.cc:302] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 523f229b9d294095a6c9636629613e98, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:34.298300 18944 raft_consensus.cc:2781] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:38:34.298403 18944 raft_consensus.cc:482] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:38:34.298574 18944 raft_consensus.cc:3037] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:34.300891 18944 raft_consensus.cc:504] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.301513 18944 leader_election.cc:288] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 election: Requested vote from peers 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389), 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033)
I20260808 02:38:34.302282 18620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52bf61f636040d5960eb856951e9e10" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934084151eda4cb0a84c5e0dd44e8c04"
I20260808 02:38:34.302280 18764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52bf61f636040d5960eb856951e9e10" candidate_uuid: "29859a125675468383936fe7a4d4ce47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523f229b9d294095a6c9636629613e98"
I20260808 02:38:34.302552 18620 raft_consensus.cc:3037] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:34.302569 18764 raft_consensus.cc:3037] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:34.305847 18764 raft_consensus.cc:2454] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 1.
I20260808 02:38:34.305876 18620 raft_consensus.cc:2454] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29859a125675468383936fe7a4d4ce47 in term 1.
I20260808 02:38:34.306502 18400 leader_election.cc:302] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 29859a125675468383936fe7a4d4ce47, 523f229b9d294095a6c9636629613e98, 934084151eda4cb0a84c5e0dd44e8c04; no voters:
I20260808 02:38:34.306939 18944 raft_consensus.cc:2781] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:34.307160 18944 raft_consensus.cc:686] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 1 LEADER]: Becoming Leader. State: Replica: 29859a125675468383936fe7a4d4ce47, State: Running, Role: LEADER
I20260808 02:38:34.307476 18944 consensus_queue.cc:237] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } }
I20260808 02:38:34.310456 18310 catalog_manager.cc:5495] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29859a125675468383936fe7a4d4ce47 (127.10.20.65). New cstate: current_term: 1 leader_uuid: "29859a125675468383936fe7a4d4ce47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29859a125675468383936fe7a4d4ce47" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 } health_report { overall_health: UNKNOWN } } }
I20260808 02:38:34.373481 18959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.367203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:38363 (local address 127.10.20.66:34389)
0808 02:38:34.367855 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:34.367861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:34.368186 (+ 325us) server_negotiation.cc:407] Connection header received
0808 02:38:34.368479 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:34.368483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:34.368554 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:34.368671 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:34.369221 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.369968 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.371563 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.371980 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.372121 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.372608 (+ 487us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:34.372718 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:34.372819 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:34.372972 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 02:38:34.373062 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":330,"threads_started":1}
I20260808 02:38:34.373488 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.367173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34389 (local address 127.10.20.65:38363)
0808 02:38:34.368064 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:34.368082 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:34.368282 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:34.368685 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:34.368689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:34.368701 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:38:34.369064 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:34.369074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.370163 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.370168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:34.371404 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:34.371418 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.372184 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.372192 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:34.372337 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.372408 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:38:34.372821 (+ 413us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:38:34.372836 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 02:38:34.372948 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 02:38:34.373101 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":459,"threads_started":1}
I20260808 02:38:34.383702 18764 raft_consensus.cc:1261] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Refusing update from remote peer 29859a125675468383936fe7a4d4ce47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:34.383702 18620 raft_consensus.cc:1261] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Refusing update from remote peer 29859a125675468383936fe7a4d4ce47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:38:34.384390 18902 consensus_queue.cc:1035] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "934084151eda4cb0a84c5e0dd44e8c04" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:34.384699 18944 consensus_queue.cc:1035] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "523f229b9d294095a6c9636629613e98" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:38:34.420774 18948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.413272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:56257 (local address 127.10.20.65:40047)
0808 02:38:34.413525 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:34.413535 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:34.414040 (+ 505us) server_negotiation.cc:407] Connection header received
0808 02:38:34.414114 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:34.414118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:34.414188 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:34.414273 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:38:34.415038 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.415943 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.418274 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.419248 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.419425 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.419930 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:38:34.420056 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:38:34.420165 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:34.420353 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 02:38:34.420444 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:38:34.420913 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.413223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:40047 (local address 127.10.20.66:56257)
0808 02:38:34.413862 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:34.413879 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:34.414005 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:34.414271 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:34.414274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:34.414282 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 02:38:34.414542 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:34.414550 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.416113 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.416123 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:34.418074 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:34.418096 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.419495 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.419504 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:34.419680 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.419727 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 02:38:34.420198 (+ 471us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 02:38:34.420212 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 02:38:34.420321 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 02:38:34.420489 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":356,"threads_started":1}
I20260808 02:38:34.458380 18309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:34.458747 18309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:38:34.462468 18309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cae7f47591747099d577ff40979d5ee: Sending DeleteTablet for 3 replicas of tablet e52bf61f636040d5960eb856951e9e10
I20260808 02:38:34.464336 18598 tablet_service.cc:1514] Processing DeleteTablet for tablet e52bf61f636040d5960eb856951e9e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:34 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:40280
I20260808 02:38:34.464399 18744 tablet_service.cc:1514] Processing DeleteTablet for tablet e52bf61f636040d5960eb856951e9e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:34 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:43564
I20260808 02:38:34.464435 18449 tablet_service.cc:1514] Processing DeleteTablet for tablet e52bf61f636040d5960eb856951e9e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:38:34 UTC) from {username='oryx', principal='oryx/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:52906
I20260808 02:38:34.464726 18922 tablet_replica.cc:330] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: stopping tablet replica
I20260808 02:38:34.464726 18921 tablet_replica.cc:330] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: stopping tablet replica
I20260808 02:38:34.464844 18920 tablet_replica.cc:330] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: stopping tablet replica
I20260808 02:38:34.464923 18922 raft_consensus.cc:2229] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:34.464926 18921 raft_consensus.cc:2229] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:38:34.465034 18920 raft_consensus.cc:2229] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:38:34.465160 18921 raft_consensus.cc:2258] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:34.465162 18922 raft_consensus.cc:2258] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:34.465418 18920 raft_consensus.cc:2258] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:38:34.466372 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 18383
I20260808 02:38:34.466730 18921 ts_tablet_manager.cc:1905] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:34.467741 18922 ts_tablet_manager.cc:1905] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:34.468338 18920 ts_tablet_manager.cc:1905] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:38:34.474375 18921 ts_tablet_manager.cc:1918] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:38:34.474573 18921 log.cc:1196] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/e52bf61f636040d5960eb856951e9e10
I20260808 02:38:34.475468 18921 ts_tablet_manager.cc:1939] T e52bf61f636040d5960eb856951e9e10 P 523f229b9d294095a6c9636629613e98: Deleting consensus metadata
I20260808 02:38:34.476598 18920 ts_tablet_manager.cc:1918] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:38:34.476521 18922 ts_tablet_manager.cc:1918] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 02:38:34.476796 18296 catalog_manager.cc:4841] TS 523f229b9d294095a6c9636629613e98 (127.10.20.67:37033): tablet e52bf61f636040d5960eb856951e9e10 (table test-table [id=84fb73aceb2e4f0488229e29ac6270af]) successfully deleted
I20260808 02:38:34.476848 18920 log.cc:1196] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/e52bf61f636040d5960eb856951e9e10
I20260808 02:38:34.477020 18922 log.cc:1196] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/e52bf61f636040d5960eb856951e9e10
I20260808 02:38:34.477502 18922 ts_tablet_manager.cc:1939] T e52bf61f636040d5960eb856951e9e10 P 934084151eda4cb0a84c5e0dd44e8c04: Deleting consensus metadata
I20260808 02:38:34.477514 18920 ts_tablet_manager.cc:1939] T e52bf61f636040d5960eb856951e9e10 P 29859a125675468383936fe7a4d4ce47: Deleting consensus metadata
I20260808 02:38:34.478874 18294 catalog_manager.cc:4841] TS 934084151eda4cb0a84c5e0dd44e8c04 (127.10.20.66:34389): tablet e52bf61f636040d5960eb856951e9e10 (table test-table [id=84fb73aceb2e4f0488229e29ac6270af]) successfully deleted
I20260808 02:38:34.479192 18294 catalog_manager.cc:4841] TS 29859a125675468383936fe7a4d4ce47 (127.10.20.65:40047): tablet e52bf61f636040d5960eb856951e9e10 (table test-table [id=84fb73aceb2e4f0488229e29ac6270af]) successfully deleted
Aug 08 02:38:34 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.65@KRBTEST.COM
I20260808 02:38:34.489073 18948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.467966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40790 (local address 127.10.20.65:40047)
0808 02:38:34.468525 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:34.468531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:34.468553 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:38:34.468617 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:34.468622 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:34.468730 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:34.468856 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:34.470871 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.472082 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.474183 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.474971 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.475106 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.481288 (+ 6182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:34.481317 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:34.481345 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:34.481404 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:34.485066 (+ 3662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:34.486146 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:34.486154 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:34.486157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:34.486331 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:34.486897 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:34.486902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:34.486904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:34.487639 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:34.487944 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:34.488421 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 02:38:34.488702 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397}
I20260808 02:38:34.489823 18522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:34.632740 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 18383
I20260808 02:38:34.663211 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 18531
Aug 08 02:38:34 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.66@KRBTEST.COM
I20260808 02:38:34.684510 18959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.664379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44316 (local address 127.10.20.66:34389)
0808 02:38:34.664578 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:34.664583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:34.664605 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:38:34.664934 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:34.664939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:34.665022 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:34.665189 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:34.666868 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.667875 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.669321 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.669824 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.669997 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.676594 (+ 6597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:34.676615 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:34.676633 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:34.676683 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:34.680724 (+ 4041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:34.681676 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:34.681684 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:34.681687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:34.681848 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:34.682419 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:34.682423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:34.682425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:34.682987 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:34.683318 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:34.683901 (+ 583us) server_negotiation.cc:299] Negotiation successful
0808 02:38:34.684211 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:38:34.685312 18666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:34.821339 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 18531
I20260808 02:38:34.848539 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 18676
Aug 08 02:38:34 dist-test-slave-8tdl krb5kdc[18261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.20.67@KRBTEST.COM
I20260808 02:38:34.866818 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:34.849420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.10.20.67:37033)
0808 02:38:34.849979 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:34.849984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:34.849999 (+ 15us) server_negotiation.cc:407] Connection header received
0808 02:38:34.850054 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:34.850058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:34.850134 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:34.850261 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:34.851821 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.852563 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.853921 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:34.854332 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:34.854481 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:34.859660 (+ 5179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:34.859684 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:34.859702 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:34.859759 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:34.863400 (+ 3641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:34.864269 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:34.864278 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:34.864281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:34.864457 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:34.864897 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:34.864904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:34.864912 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:34.865340 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:34.865694 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:34.866040 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 02:38:34.866321 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":311,"threads_started":1}
I20260808 02:38:34.867740 18811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:35.007753 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 18676
I20260808 02:38:35.040874 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 18276
I20260808 02:38:35.042518 18350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:35.170830 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 18276
2026-08-08T02:38:35Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (8310 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:38:35 dist-test-slave-8tdl krb5kdc[18975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:38:35 dist-test-slave-8tdl krb5kdc[18975](info): set up 2 sockets
Aug 08 02:38:35 dist-test-slave-8tdl krb5kdc[18975](info): commencing operation
krb5kdc: starting...
W20260808 02:38:36.441650 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:38:36 dist-test-slave-8tdl krb5kdc[18975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:38:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:38:36.793730 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37313
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:41089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:37.190281 18988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:37.190758 18988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:37.190955 18988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:37.198932 18988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:37.199126 18988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:37.199240 18988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:37.199344 18988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:37.199438 18988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:37.210052 18988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:41089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:37.211608 18988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:37.213127 18988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:37.226998 18993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:37.227051 18996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:37.227226 18994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:37.228729 18988 server_base.cc:1034] running on GCE node
I20260808 02:38:37.229908 18988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:37.231769 18988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:37.233079 18988 hybrid_clock.cc:648] HybridClock initialized: now 1786156717233012 us; error 72 us; skew 500 ppm
I20260808 02:38:37.233541 18988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T02:38:37Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2136 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:38:37 dist-test-slave-8tdl krb5kdc[19002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:38:37 dist-test-slave-8tdl krb5kdc[19002](info): set up 2 sockets
Aug 08 02:38:37 dist-test-slave-8tdl krb5kdc[19002](info): commencing operation
krb5kdc: starting...
W20260808 02:38:38.528759 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.003s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:38:38 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:38:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:38:38.892704 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46391
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:46391
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:39.273731 19015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:39.274085 19015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:39.274183 19015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:39.281875 19015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:39.282019 19015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:39.282068 19015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:39.282119 19015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:39.282166 19015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:39.292686 19015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:46391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:39.294134 19015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:39.295609 19015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:39.310375 19023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:39.310400 19020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:39.310537 19021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:39.311905 19015 server_base.cc:1034] running on GCE node
I20260808 02:38:39.313068 19015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:39.315021 19015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:39.316304 19015 hybrid_clock.cc:648] HybridClock initialized: now 1786156719316236 us; error 97 us; skew 500 ppm
I20260808 02:38:39.316753 19015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:39 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156719, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:39.320935 19015 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:38:39.323127 19015 webserver.cc:460] Webserver started at http://127.10.20.126:41933/ using document root <none> and password file <none>
I20260808 02:38:39.324036 19015 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:39.324218 19015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:39.324604 19015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:39.328378 19015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "2fcd8652d03f4fbcb992d06b98bb186e"
format_stamp: "Formatted at 2026-08-08 02:38:39 on dist-test-slave-8tdl"
server_key: "987c16273e4fca0de5da8d14ac5c3af0"
server_key_iv: "345ce9f3a5f21d40360a5f11e8c3c4a1"
server_key_version: "encryptionkey@0"
I20260808 02:38:39.329371 19015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "2fcd8652d03f4fbcb992d06b98bb186e"
format_stamp: "Formatted at 2026-08-08 02:38:39 on dist-test-slave-8tdl"
server_key: "987c16273e4fca0de5da8d14ac5c3af0"
server_key_iv: "345ce9f3a5f21d40360a5f11e8c3c4a1"
server_key_version: "encryptionkey@0"
I20260808 02:38:39.336298 19015 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:38:39.340634 19030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:39.342482 19015 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 02:38:39.342831 19015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "2fcd8652d03f4fbcb992d06b98bb186e"
format_stamp: "Formatted at 2026-08-08 02:38:39 on dist-test-slave-8tdl"
server_key: "987c16273e4fca0de5da8d14ac5c3af0"
server_key_iv: "345ce9f3a5f21d40360a5f11e8c3c4a1"
server_key_version: "encryptionkey@0"
I20260808 02:38:39.343087 19015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:39.357225 19015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:39.363195 19015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:39.363564 19015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:39.387377 19015 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:46391
I20260808 02:38:39.387404 19086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:46391 every 8 connection(s)
I20260808 02:38:39.389132 19015 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:39.393646 19087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:38:39.398371 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19015
I20260808 02:38:39.398634 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:38:39.399398 10321 external_mini_cluster.cc:1428] Setting key b2563c0d1465e027cff0a73e867610da
I20260808 02:38:39.409572 19087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Bootstrap starting.
I20260808 02:38:39.414058 19087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Neither blocks nor log segments found. Creating new log.
I20260808 02:38:39.415735 19087 log.cc:824] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:38:39 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:39.419659 19087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: No bootstrap required, opened a new log
I20260808 02:38:39.427652 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:39.401733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.10.20.126:46391)
0808 02:38:39.402640 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:39.402652 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:39.402759 (+ 107us) server_negotiation.cc:407] Connection header received
0808 02:38:39.404574 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:39.404602 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:39.405097 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:39.405478 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:39.407811 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:39.409406 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:39.411378 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:39.412246 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:39.412424 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:39.418260 (+ 5836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:39.418269 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:39.418285 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:39.418326 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:39.422028 (+ 3702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:39.423226 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:39.423235 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:39.423244 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:39.423548 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:39.424068 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:39.424081 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:39.424084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:39.424812 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:39.425138 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:39.425728 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 02:38:39.426350 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":433,"threads_started":1}
I20260808 02:38:39.429337 19087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:39.429736 19087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:38:39.429901 19087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fcd8652d03f4fbcb992d06b98bb186e, State: Initialized, Role: FOLLOWER
I20260808 02:38:39.430613 19087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:39.430995 19087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:39.431191 19087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:39.431402 19087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:38:39.433933 19087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:39.434640 19087 leader_election.cc:302] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fcd8652d03f4fbcb992d06b98bb186e; no voters:
I20260808 02:38:39.435454 19087 leader_election.cc:288] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:38:39.435657 19092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:38:39.436497 19092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 LEADER]: Becoming Leader. State: Replica: 2fcd8652d03f4fbcb992d06b98bb186e, State: Running, Role: LEADER
I20260808 02:38:39.437168 19092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:39.437947 19087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:39.441144 19093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } } }
I20260808 02:38:39.441524 19093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:39.441865 19095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fcd8652d03f4fbcb992d06b98bb186e. Latest consensus state: current_term: 1 leader_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } } }
I20260808 02:38:39.442258 19095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:39.442638 19101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:39.449453 19101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:39.463183 19101 catalog_manager.cc:1347] Generated new cluster ID: 0713d8d3569743cab81bd1d6bd87d8af
I20260808 02:38:39.463356 19101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:39.486557 19101 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:38:39.488620 19101 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:39.503795 19101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Generated new TSK 0
I20260808 02:38:39.504769 19101 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:38:39.595954 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46391
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:39.990630 19115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:39.991032 19115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:39.991256 19115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:39.999162 19115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:39.999301 19115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:39.999490 19115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:40.010561 19115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:40.012163 19115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:40.013628 19115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:40.029306 19122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:40.029351 19124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:40.029373 19121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:40.040943 19115 server_base.cc:1034] running on GCE node
I20260808 02:38:40.041844 19115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:40.043071 19115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:40.044324 19115 hybrid_clock.cc:648] HybridClock initialized: now 1786156720044282 us; error 36 us; skew 500 ppm
I20260808 02:38:40.044725 19115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:40 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156720, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:40.048895 19115 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:38:40.050590 19115 webserver.cc:460] Webserver started at http://127.10.20.65:44427/ using document root <none> and password file <none>
I20260808 02:38:40.051596 19115 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:40.051766 19115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:40.052174 19115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:40.055624 19115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "4ebec4c142e44e04b8ef93f0b82efedf"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "66540907207553c771a800c8901aa73a"
server_key_iv: "93da916ed7be1778c303cb6ccf44a4cd"
server_key_version: "encryptionkey@0"
I20260808 02:38:40.056571 19115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "4ebec4c142e44e04b8ef93f0b82efedf"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "66540907207553c771a800c8901aa73a"
server_key_iv: "93da916ed7be1778c303cb6ccf44a4cd"
server_key_version: "encryptionkey@0"
I20260808 02:38:40.062885 19115 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:38:40.067224 19131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:40.068825 19115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 02:38:40.069000 19115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "4ebec4c142e44e04b8ef93f0b82efedf"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "66540907207553c771a800c8901aa73a"
server_key_iv: "93da916ed7be1778c303cb6ccf44a4cd"
server_key_version: "encryptionkey@0"
I20260808 02:38:40.069257 19115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:40.097585 19115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:40.103144 19115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:40.103497 19115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:40.104740 19115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:40.106343 19115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:40.106434 19115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:40.106525 19115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:40.106571 19115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:40.146497 19115 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:38487
I20260808 02:38:40.146564 19247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:38487 every 8 connection(s)
I20260808 02:38:40.148099 19115 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:40.154296 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19115
I20260808 02:38:40.154561 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:38:40.155562 10321 external_mini_cluster.cc:1428] Setting key 4c7e232d0a5f79ed5b822ae2ba308d10
Aug 08 02:38:40 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156720, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:40.177227 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:40.151241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:40707 (local address 127.10.20.126:46391)
0808 02:38:40.151976 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:40.151981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:40.153204 (+ 1223us) server_negotiation.cc:407] Connection header received
0808 02:38:40.155540 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:40.155547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:40.155653 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:40.155796 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:40.158167 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.159165 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.162187 (+ 3022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.162814 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.162956 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:40.168280 (+ 5324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:40.168291 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:40.168298 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:40.168365 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:40.172409 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:40.173935 (+ 1526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:40.173943 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:40.173946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:40.174204 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:40.174919 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:40.174934 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:40.174937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:40.175276 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:40.175471 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:40.176447 (+ 976us) server_negotiation.cc:299] Negotiation successful
0808 02:38:40.176755 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":401,"threads_started":1}
I20260808 02:38:40.178391 19251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:40.152019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:40707)
0808 02:38:40.153028 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:40.153072 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:40.155193 (+ 2121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:40.156177 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:40.156192 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:40.157083 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:40.157866 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:40.157900 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.159401 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.159410 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:40.161898 (+ 2488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:40.161928 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.163133 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.163143 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:40.163538 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:40.164505 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:40.164544 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:40.167920 (+ 3376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:40.172688 (+ 4768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:40.172704 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:40.172730 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:40.173674 (+ 944us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:40.174385 (+ 711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:40.174391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:40.174395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:40.174747 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:40.175466 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:40.175476 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:40.175939 (+ 463us) client_negotiation.cc:769] Sending connection context
0808 02:38:40.176287 (+ 348us) client_negotiation.cc:240] Negotiation successful
0808 02:38:40.176989 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":294,"threads_started":1}
I20260808 02:38:40.180660 19248 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46391
I20260808 02:38:40.181137 19248 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:40.181995 19248 heartbeater.cc:511] Master 127.10.20.126:46391 requested a full tablet report, sending...
I20260808 02:38:40.184849 19049 ts_manager.cc:194] Registered new tserver with Master: 4ebec4c142e44e04b8ef93f0b82efedf (127.10.20.65:38487)
I20260808 02:38:40.187316 19049 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:40707
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:38:40.240258 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46391
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:40.637707 19254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:40.638173 19254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:40.638427 19254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:40.646554 19254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:40.646822 19254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:40.647104 19254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:40.658829 19254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:40.660449 19254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:40.661985 19254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:40.678897 19260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:40.678778 19261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:40.678927 19263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:40.679862 19254 server_base.cc:1034] running on GCE node
I20260808 02:38:40.680661 19254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:40.681852 19254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:40.683138 19254 hybrid_clock.cc:648] HybridClock initialized: now 1786156720683094 us; error 67 us; skew 500 ppm
I20260808 02:38:40.683558 19254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:40 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156720, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:40.687644 19254 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:38:40.689682 19254 webserver.cc:460] Webserver started at http://127.10.20.66:37557/ using document root <none> and password file <none>
I20260808 02:38:40.690528 19254 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:40.690665 19254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:40.691092 19254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:40.694649 19254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "804c1c20ef39453c86196e815c6c27fe"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "f3eda9eeeb26729305e54da838e35e17"
server_key_iv: "d12afa3a50e60688179231dc2bdd3c1f"
server_key_version: "encryptionkey@0"
I20260808 02:38:40.695752 19254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "804c1c20ef39453c86196e815c6c27fe"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "f3eda9eeeb26729305e54da838e35e17"
server_key_iv: "d12afa3a50e60688179231dc2bdd3c1f"
server_key_version: "encryptionkey@0"
I20260808 02:38:40.702474 19254 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260808 02:38:40.707391 19271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:40.709110 19254 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:38:40.709287 19254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "804c1c20ef39453c86196e815c6c27fe"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "f3eda9eeeb26729305e54da838e35e17"
server_key_iv: "d12afa3a50e60688179231dc2bdd3c1f"
server_key_version: "encryptionkey@0"
I20260808 02:38:40.709509 19254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:40.743219 19254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:40.748651 19254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:40.748944 19254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:40.750101 19254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:40.751704 19254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:40.751789 19254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:40.751896 19254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:40.751947 19254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:40.790395 19254 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:37579
I20260808 02:38:40.790428 19387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:37579 every 8 connection(s)
I20260808 02:38:40.791862 19254 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:40.799602 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19254
I20260808 02:38:40.799845 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:38:40.800325 10321 external_mini_cluster.cc:1428] Setting key d9c783c4c10c58b92fcf678212c9743d
Aug 08 02:38:40 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156720, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:40.816807 19390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:40.795005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:33191 (local address 127.10.20.126:46391)
0808 02:38:40.795558 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:40.795563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:40.796572 (+ 1009us) server_negotiation.cc:407] Connection header received
0808 02:38:40.798701 (+ 2129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:40.798709 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:40.798812 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:40.798941 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:40.800842 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.801856 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.804203 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.804726 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.804900 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:40.809775 (+ 4875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:40.809781 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:40.809784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:40.809824 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:40.812952 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:40.814006 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:40.814011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:40.814014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:40.814150 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:40.814667 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:40.814714 (+ 47us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:40.814717 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:40.815129 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:40.815303 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:40.816114 (+ 811us) server_negotiation.cc:299] Negotiation successful
0808 02:38:40.816405 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":330,"threads_started":1}
I20260808 02:38:40.817932 19391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:40.795535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:33191)
0808 02:38:40.796376 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:40.796417 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:40.798315 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:40.799232 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:40.799242 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:40.799915 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:40.800636 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:40.800658 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.802099 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.802104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:40.803949 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:40.803967 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:40.805045 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:40.805055 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:40.805331 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:40.806431 (+ 1100us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:40.806469 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:40.809432 (+ 2963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:40.813184 (+ 3752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:40.813197 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:40.813221 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:40.813837 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:40.814276 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:40.814283 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:40.814289 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:40.814527 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:40.815272 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:40.815280 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:40.815694 (+ 414us) client_negotiation.cc:769] Sending connection context
0808 02:38:40.816002 (+ 308us) client_negotiation.cc:240] Negotiation successful
0808 02:38:40.816666 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":323,"threads_started":1}
I20260808 02:38:40.819777 19388 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46391
I20260808 02:38:40.820194 19388 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:40.821365 19388 heartbeater.cc:511] Master 127.10.20.126:46391 requested a full tablet report, sending...
I20260808 02:38:40.823436 19049 ts_manager.cc:194] Registered new tserver with Master: 804c1c20ef39453c86196e815c6c27fe (127.10.20.66:37579)
I20260808 02:38:40.824925 19049 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:33191
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:38:40.879676 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46391
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:41.191411 19248 heartbeater.cc:503] Master 127.10.20.126:46391 was elected leader, sending a full tablet report...
W20260808 02:38:41.255852 19394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:41.256188 19394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:41.256289 19394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:41.264214 19394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:41.264354 19394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:41.264474 19394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:41.275419 19394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:41.276899 19394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:41.278802 19394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:41.294209 19399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:41.294266 19400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:41.294288 19403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:41.295270 19394 server_base.cc:1034] running on GCE node
I20260808 02:38:41.296046 19394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:41.297235 19394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:41.298517 19394 hybrid_clock.cc:648] HybridClock initialized: now 1786156721298452 us; error 62 us; skew 500 ppm
I20260808 02:38:41.299064 19394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:41 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156721, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:41.302778 19394 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:38:41.304697 19394 webserver.cc:460] Webserver started at http://127.10.20.67:33977/ using document root <none> and password file <none>
I20260808 02:38:41.305589 19394 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:41.305763 19394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:41.306131 19394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:38:41.309556 19394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "9a1849f96cf841c4bb2598aa3e1a477a"
format_stamp: "Formatted at 2026-08-08 02:38:41 on dist-test-slave-8tdl"
server_key: "be6c63a77c1bc0feb36b85fcd1d723ba"
server_key_iv: "429887e909ccc270c8bc97b9e7759475"
server_key_version: "encryptionkey@0"
I20260808 02:38:41.310499 19394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "9a1849f96cf841c4bb2598aa3e1a477a"
format_stamp: "Formatted at 2026-08-08 02:38:41 on dist-test-slave-8tdl"
server_key: "be6c63a77c1bc0feb36b85fcd1d723ba"
server_key_iv: "429887e909ccc270c8bc97b9e7759475"
server_key_version: "encryptionkey@0"
I20260808 02:38:41.317453 19394 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:38:41.321866 19410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:41.323640 19394 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:38:41.323863 19394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9a1849f96cf841c4bb2598aa3e1a477a"
format_stamp: "Formatted at 2026-08-08 02:38:41 on dist-test-slave-8tdl"
server_key: "be6c63a77c1bc0feb36b85fcd1d723ba"
server_key_iv: "429887e909ccc270c8bc97b9e7759475"
server_key_version: "encryptionkey@0"
I20260808 02:38:41.324110 19394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:41.340592 19394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:41.345846 19394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:41.346192 19394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:41.347518 19394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:41.349138 19394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:41.349254 19394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:41.349400 19394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:41.349493 19394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:41.389777 19394 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:38475
I20260808 02:38:41.389794 19527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:38475 every 8 connection(s)
I20260808 02:38:41.391559 19394 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:41.396368 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19394
I20260808 02:38:41.396621 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:38:41.397094 10321 external_mini_cluster.cc:1428] Setting key 9446498d5631ead49941afd6fbfd0990
Aug 08 02:38:41 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156721, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:38:41.417476 19530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:41.394614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:54379 (local address 127.10.20.126:46391)
0808 02:38:41.395205 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:41.395212 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:41.396604 (+ 1392us) server_negotiation.cc:407] Connection header received
0808 02:38:41.399416 (+ 2812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:41.399420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:41.399555 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:41.399677 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:41.401908 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.402837 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.404763 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.405223 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.405336 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:41.409733 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:41.409739 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:41.409743 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:41.409792 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:41.413486 (+ 3694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.414551 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.414556 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.414560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.414821 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.415416 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.415420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.415422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.415747 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:41.415875 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:41.416888 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0808 02:38:41.417117 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":273,"threads_started":1}
I20260808 02:38:41.418391 19531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:41.395316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:54379)
0808 02:38:41.396297 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:41.396363 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:41.399058 (+ 2695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:41.400159 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:41.400173 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:41.401081 (+ 908us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:41.401726 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:41.401746 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.403076 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.403081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:41.404576 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:41.404592 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.405474 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.405480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:41.405713 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:41.406615 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:41.406644 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:41.409431 (+ 2787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:38:41.413709 (+ 4278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:41.413724 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:41.413749 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:41.414384 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:41.414951 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:38:41.414955 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:38:41.414957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:38:41.415234 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:38:41.415985 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:38:41.415993 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:38:41.416414 (+ 421us) client_negotiation.cc:769] Sending connection context
0808 02:38:41.416714 (+ 300us) client_negotiation.cc:240] Negotiation successful
0808 02:38:41.417171 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":333,"threads_started":1}
I20260808 02:38:41.420208 19528 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46391
I20260808 02:38:41.420655 19528 heartbeater.cc:464] Registering TS with master...
I20260808 02:38:41.421546 19528 heartbeater.cc:511] Master 127.10.20.126:46391 requested a full tablet report, sending...
I20260808 02:38:41.423375 19049 ts_manager.cc:194] Registered new tserver with Master: 9a1849f96cf841c4bb2598aa3e1a477a (127.10.20.67:38475)
I20260808 02:38:41.424259 19049 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:54379
I20260808 02:38:41.427259 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab.
Entry for principal oryx/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab.
WARNING: no policy specified for oryx/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab.
Entry for principal oryx/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab.
WARNING: no policy specified for oryx/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab.
Entry for principal oryx/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab.
I20260808 02:38:41.643045 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19115
Aug 08 02:38:41 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:38:41.663403 19539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:41.644532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.10.20.65:38487)
0808 02:38:41.645387 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:41.645400 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:41.645429 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:38:41.645496 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:41.645503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:41.645711 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:41.645868 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:41.647681 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.648958 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.650408 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.651333 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.651463 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:41.656431 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:41.656450 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:41.656467 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:41.656557 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:41.659993 (+ 3436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.660952 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.660961 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.660964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.661129 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.661576 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.661580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.661583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.661962 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:41.662316 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:41.662648 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 02:38:41.662992 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":466,"threads_started":1}
I20260808 02:38:41.664800 19243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:41.767096 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19115
I20260808 02:38:41.787465 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19254
Aug 08 02:38:41 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:38:41.807237 19541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:41.788526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54150 (local address 127.10.20.66:37579)
0808 02:38:41.789152 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:41.789159 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:41.789186 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:38:41.789253 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:41.789259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:41.789517 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:41.789718 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:41.791333 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.792667 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.794058 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.794773 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.794934 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:41.799903 (+ 4969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:41.799919 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:41.799935 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:41.799981 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:41.803916 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.804767 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.804775 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.804777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.804935 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.805386 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.805391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.805394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.805787 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:41.806124 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:41.806486 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 02:38:41.806833 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":353,"threads_started":1}
I20260808 02:38:41.808704 19383 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:41.897475 19388 heartbeater.cc:503] Master 127.10.20.126:46391 was elected leader, sending a full tablet report...
I20260808 02:38:41.898945 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19254
W20260808 02:38:41.917539 19035 connection.cc:535] server connection from 127.10.20.66:33191 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:38:41.917975 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19394
Aug 08 02:38:41 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:38:41.938062 19544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:41.919023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56348 (local address 127.10.20.67:38475)
0808 02:38:41.919637 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:41.919645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:41.919676 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:38:41.919749 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:41.919755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:41.919996 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:41.920204 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:41.921639 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.922888 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.924255 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:41.924894 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:41.925074 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:41.930361 (+ 5287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:41.930379 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:41.930396 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:41.930445 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:41.934094 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.935324 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.935334 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.935337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.935505 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:41.936119 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:41.936124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:41.936126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:41.936563 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:41.936840 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:41.937342 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 02:38:41.937635 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":338,"threads_started":1}
I20260808 02:38:41.939721 19523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:42.027190 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19394
I20260808 02:38:42.047330 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19015
I20260808 02:38:42.048635 19082 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:42.162169 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19015
I20260808 02:38:42.187810 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46391
--webserver_interface=127.10.20.126
--webserver_port=41933
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:46391
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:38:42.575553 19547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:42.575930 19547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:42.576037 19547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:42.583961 19547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:38:42.584102 19547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:42.584153 19547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:42.584214 19547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:38:42.584260 19547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:38:42.594856 19547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:46391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=41933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:42.596318 19547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:42.597693 19547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:42.611913 19552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:42.612013 19555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:42.612274 19553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:42.613499 19547 server_base.cc:1034] running on GCE node
I20260808 02:38:42.614542 19547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:42.616427 19547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:42.617709 19547 hybrid_clock.cc:648] HybridClock initialized: now 1786156722617650 us; error 53 us; skew 500 ppm
I20260808 02:38:42.618211 19547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:42 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156722, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:42.626767 19547 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:38:42.628723 19547 webserver.cc:460] Webserver started at http://127.10.20.126:41933/ using document root <none> and password file <none>
I20260808 02:38:42.629575 19547 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:42.629725 19547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:42.637243 19547 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:38:42.641186 19562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:42.643193 19547 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:38:42.643448 19547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "2fcd8652d03f4fbcb992d06b98bb186e"
format_stamp: "Formatted at 2026-08-08 02:38:39 on dist-test-slave-8tdl"
server_key: "987c16273e4fca0de5da8d14ac5c3af0"
server_key_iv: "345ce9f3a5f21d40360a5f11e8c3c4a1"
server_key_version: "encryptionkey@0"
I20260808 02:38:42.644532 19547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:42.667780 19547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:42.673235 19547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:42.673566 19547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:42.695780 19614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:46391 every 8 connection(s)
I20260808 02:38:42.695894 19547 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:46391
I20260808 02:38:42.697782 19547 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:38:42.704521 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19547
I20260808 02:38:42.705595 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:38487
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:46391
--webserver_port=44427
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:38:42.706710 19615 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:38:42.712560 19615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Bootstrap starting.
I20260808 02:38:42.736353 19615 log.cc:824] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:38:42.747290 19615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:38:42.747941 19615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Bootstrap complete.
I20260808 02:38:42.759047 19615 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:42.760015 19615 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fcd8652d03f4fbcb992d06b98bb186e, State: Initialized, Role: FOLLOWER
I20260808 02:38:42.760756 19615 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:42.761076 19615 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:38:42.761232 19615 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:38:42.761435 19615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:38:42.765848 19615 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:42.766482 19615 leader_election.cc:302] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fcd8652d03f4fbcb992d06b98bb186e; no voters:
I20260808 02:38:42.767271 19615 leader_election.cc:288] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:38:42.767446 19619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:38:42.768999 19619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [term 2 LEADER]: Becoming Leader. State: Replica: 2fcd8652d03f4fbcb992d06b98bb186e, State: Running, Role: LEADER
I20260808 02:38:42.769759 19619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } }
I20260808 02:38:42.770035 19615 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:38:42.772855 19621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fcd8652d03f4fbcb992d06b98bb186e. Latest consensus state: current_term: 2 leader_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } } }
I20260808 02:38:42.773584 19621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:42.773397 19620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fcd8652d03f4fbcb992d06b98bb186e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46391 } } }
I20260808 02:38:42.774443 19620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e [sys.catalog]: This master's current role is: LEADER
I20260808 02:38:42.776832 19626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:38:42.783676 19626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:38:42.785326 19626 catalog_manager.cc:1259] Loaded cluster ID: 0713d8d3569743cab81bd1d6bd87d8af
I20260808 02:38:42.785557 19626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:38:42.791451 19626 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:38:42.793622 19626 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2fcd8652d03f4fbcb992d06b98bb186e: Loaded TSK: 0
I20260808 02:38:42.796028 19626 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:38:43.097450 19617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:43.097775 19617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:43.097926 19617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:43.105993 19617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:43.106132 19617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:43.106315 19617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:38:43.117132 19617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.65.keytab
--principal=oryx/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:38487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=44427
--tserver_master_addrs=127.10.20.126:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:43.118719 19617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:43.120177 19617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:43.136713 19643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:43.136731 19645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:43.137553 19642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:43.140642 19617 server_base.cc:1034] running on GCE node
I20260808 02:38:43.141484 19617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:43.142700 19617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:43.144004 19617 hybrid_clock.cc:648] HybridClock initialized: now 1786156723143917 us; error 71 us; skew 500 ppm
I20260808 02:38:43.144407 19617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:43 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156723, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:43.148267 19617 init.cc:377] Logged in from keytab as oryx/127.10.20.65@KRBTEST.COM (short username oryx)
I20260808 02:38:43.150328 19617 webserver.cc:460] Webserver started at http://127.10.20.65:44427/ using document root <none> and password file <none>
I20260808 02:38:43.151252 19617 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:43.151422 19617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:43.157896 19617 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 02:38:43.161150 19653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:43.163486 19617 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:38:43.163708 19617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "4ebec4c142e44e04b8ef93f0b82efedf"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "66540907207553c771a800c8901aa73a"
server_key_iv: "93da916ed7be1778c303cb6ccf44a4cd"
server_key_version: "encryptionkey@0"
I20260808 02:38:43.165144 19617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:43.195406 19617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:43.200573 19617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:43.200914 19617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:43.202173 19617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:43.203775 19617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:43.203886 19617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:43.204015 19617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:43.204119 19617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:43.244979 19617 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:38487
I20260808 02:38:43.245093 19770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:38487 every 8 connection(s)
I20260808 02:38:43.247118 19617 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:38:43.253929 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19617
I20260808 02:38:43.254760 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:37579
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:46391
--webserver_port=37557
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:38:43 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:43 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:38:43.702181 19775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:43.702543 19775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:43.702800 19775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:43.711004 19775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:43.711191 19775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:43.711447 19775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:38:43.724582 19775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.66.keytab
--principal=oryx/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:37579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=37557
--tserver_master_addrs=127.10.20.126:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:43.726933 19775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:43.729460 19775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:43.752285 19782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:43.752307 19781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:43.753091 19784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:43.754475 19775 server_base.cc:1034] running on GCE node
I20260808 02:38:43.755784 19775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:43.757797 19775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:43.759173 19775 hybrid_clock.cc:648] HybridClock initialized: now 1786156723759055 us; error 73 us; skew 500 ppm
I20260808 02:38:43.759807 19775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:43 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156723, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:43.766858 19775 init.cc:377] Logged in from keytab as oryx/127.10.20.66@KRBTEST.COM (short username oryx)
I20260808 02:38:43.770112 19775 webserver.cc:460] Webserver started at http://127.10.20.66:37557/ using document root <none> and password file <none>
I20260808 02:38:43.771641 19775 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:43.771911 19775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:43.783967 19775 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.006s sys 0.000s
I20260808 02:38:43.790802 19792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:43.793730 19775 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:38:43.794121 19775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "804c1c20ef39453c86196e815c6c27fe"
format_stamp: "Formatted at 2026-08-08 02:38:40 on dist-test-slave-8tdl"
server_key: "f3eda9eeeb26729305e54da838e35e17"
server_key_iv: "d12afa3a50e60688179231dc2bdd3c1f"
server_key_version: "encryptionkey@0"
I20260808 02:38:43.796512 19775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:43.868988 19775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:43.875732 19775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:43.876103 19775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:43.877460 19775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:43.879276 19775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:43.879411 19775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:43.879561 19775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:43.879653 19775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:43.939143 19775 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:37579
I20260808 02:38:43.939191 19910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:37579 every 8 connection(s)
I20260808 02:38:43.941445 19775 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:38:43.948948 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19775
I20260808 02:38:43.950263 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:38475
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:46391
--webserver_port=33977
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:38:43 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:43 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:38:44.347052 19916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:38:44.347426 19916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:38:44.347607 19916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:38:44.356467 19916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:38:44.356662 19916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:38:44.356861 19916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:38:44.367833 19916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/krb5kdc/oryx_127.10.20.67.keytab
--principal=oryx/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:38475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=33977
--tserver_master_addrs=127.10.20.126:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:38:44.369599 19916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:38:44.371392 19916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:38:44.392027 19922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:44.399236 19923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:38:44.400326 19925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:38:44.401847 19916 server_base.cc:1034] running on GCE node
I20260808 02:38:44.402791 19916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:38:44.404034 19916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:38:44.405289 19916 hybrid_clock.cc:648] HybridClock initialized: now 1786156724405217 us; error 69 us; skew 500 ppm
I20260808 02:38:44.405704 19916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156724, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:38:44.409751 19916 init.cc:377] Logged in from keytab as oryx/127.10.20.67@KRBTEST.COM (short username oryx)
I20260808 02:38:44.415752 19916 webserver.cc:460] Webserver started at http://127.10.20.67:33977/ using document root <none> and password file <none>
I20260808 02:38:44.416643 19916 fs_manager.cc:359] Metadata directory not provided
I20260808 02:38:44.416833 19916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:38:44.423445 19916 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:38:44.427039 19932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:44.428756 19916 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:38:44.428993 19916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9a1849f96cf841c4bb2598aa3e1a477a"
format_stamp: "Formatted at 2026-08-08 02:38:41 on dist-test-slave-8tdl"
server_key: "be6c63a77c1bc0feb36b85fcd1d723ba"
server_key_iv: "429887e909ccc270c8bc97b9e7759475"
server_key_version: "encryptionkey@0"
I20260808 02:38:44.430167 19916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:38:44.444008 19916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:38:44.449397 19916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:38:44.450019 19916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:38:44.451543 19916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:38:44.453289 19916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:38:44.453435 19916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:44.453593 19916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:38:44.453685 19916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:38:44.506552 19916 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:38475
I20260808 02:38:44.506831 20048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:38475 every 8 connection(s)
I20260808 02:38:44.508702 19916 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:38:44.518785 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 19916
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:44.551738 20055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:44.520631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36534 (local address 127.10.20.126:46391)
0808 02:38:44.524247 (+ 3616us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:44.524257 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:44.524278 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:38:44.524345 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:44.524351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:44.524607 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:44.524756 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:44.528314 (+ 3558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.529941 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.532845 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.534446 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.534910 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.540809 (+ 5899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:44.540822 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:44.540844 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:44.540904 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:44.544667 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:44.546027 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:44.546041 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:44.546056 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:44.546378 (+ 322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:38:44.547048 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:38:44.547056 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:38:44.547062 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:38:44.547965 (+ 903us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:38:44.548517 (+ 552us) server_negotiation.cc:1035] Waiting for connection context
0808 02:38:44.549698 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0808 02:38:44.550331 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":305,"server-negotiator.queue_time_us":3462,"thread_start_us":3316,"threads_started":1}
W20260808 02:38:44.921855 19773 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.655s user 0.005s sys 0.012s
W20260808 02:38:44.925820 19774 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:43.251666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:44273 (local address 127.10.20.126:46391)
0808 02:38:43.252488 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:43.252505 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:43.252737 (+ 232us) server_negotiation.cc:407] Connection header received
0808 02:38:43.256208 (+ 3471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:43.256223 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:43.256675 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:43.257064 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:43.259476 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.261100 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.263996 (+ 2896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.265111 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.265337 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.925257 (+1659920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:44273: BlockingRecv error: recv got EOF from 127.10.20.65:44273 (error 108)
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":329,"threads_started":1}
I20260808 02:38:44.927806 19773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:43.251317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:44273)
0808 02:38:43.252517 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:43.252587 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:43.255373 (+ 2786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:43.257304 (+ 1931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:43.257320 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:43.258206 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:43.259154 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:43.259187 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.261356 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.261365 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:43.263780 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:43.263808 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.265429 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.265440 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:43.265799 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:43.266725 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:43.266766 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:44.925715 (+1658949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":471,"threads_started":1}
W20260808 02:38:44.929664 19771 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:46391 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.20.126:46391: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:38:44.947448 19774 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:44.931309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:54199 (local address 127.10.20.126:46391)
0808 02:38:44.931595 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:44.931607 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:44.931902 (+ 295us) server_negotiation.cc:407] Connection header received
0808 02:38:44.932345 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:44.932356 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:44.932496 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:44.932697 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:44.934819 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.936768 (+ 1949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.939139 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.939800 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.939923 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.947155 (+ 7232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:54199: BlockingRecv error: recv got EOF from 127.10.20.65:54199 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:38:44.948496 19773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:44.930971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:54199)
0808 02:38:44.931742 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:44.931775 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:44.932099 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:44.932891 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:44.932901 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:44.933819 (+ 918us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:44.934432 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:44.934456 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.937177 (+ 2721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.937187 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:44.938925 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:44.938947 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.940276 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.940284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:44.940491 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.941294 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:44.941325 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:44.947970 (+ 6645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276}
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:44 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:44.973897 19773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:44.949882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:49865)
0808 02:38:44.950924 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:44.950957 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:44.951223 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:44.952393 (+ 1170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:44.952402 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:44.953202 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:44.953766 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:44.953789 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.957172 (+ 3383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.957184 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:44.959957 (+ 2773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:44.959999 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.962325 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.962338 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:44.962665 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.964047 (+ 1382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:44.964095 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:44.973149 (+ 9054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":851}
W20260808 02:38:44.974073 19774 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:44.950293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:49865 (local address 127.10.20.126:46391)
0808 02:38:44.950645 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:44.950656 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:44.951058 (+ 402us) server_negotiation.cc:407] Connection header received
0808 02:38:44.951438 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:44.951449 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:44.951712 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:44.951847 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:44.954040 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.956704 (+ 2664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.960326 (+ 3622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.961474 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.962028 (+ 554us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.973632 (+ 11604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:49865: BlockingRecv error: recv got EOF from 127.10.20.65:49865 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
W20260808 02:38:44.974892 19771 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:38:45.485481 19915 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.527s user 0.000s sys 0.018s
W20260808 02:38:45.487278 19914 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:43.945865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:53025 (local address 127.10.20.126:46391)
0808 02:38:43.946577 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:43.946588 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:43.949513 (+ 2925us) server_negotiation.cc:407] Connection header received
0808 02:38:43.951572 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:43.951582 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:43.951708 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:43.951831 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:43.954077 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.954986 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.956831 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.957275 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.957435 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.486843 (+1529408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:53025: BlockingRecv error: recv got EOF from 127.10.20.66:53025 (error 108)
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":319,"threads_started":1}
I20260808 02:38:45.487407 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:43.946760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:53025)
0808 02:38:43.948218 (+ 1458us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:43.948383 (+ 165us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:43.950973 (+ 2590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:43.952428 (+ 1455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:43.952438 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:43.953126 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:43.953806 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:43.953827 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.955183 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.955188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:43.956629 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:43.956646 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:43.957577 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:43.957586 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:43.957860 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:43.958662 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:43.958742 (+ 80us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.486394 (+1527652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1023,"thread_start_us":533,"threads_started":1}
W20260808 02:38:45.488269 19912 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:46391 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.20.126:46391: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:45.502470 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:45.488973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:52075)
0808 02:38:45.489286 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:45.489316 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:45.489524 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:45.489913 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:45.489921 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:45.490662 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:45.491017 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.491036 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.492238 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.492247 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.494751 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.494773 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.495825 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.495832 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.496019 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.497164 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:45.497191 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.502122 (+ 4931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":88}
W20260808 02:38:45.502625 19914 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:45.489083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:52075 (local address 127.10.20.126:46391)
0808 02:38:45.489228 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:45.489232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:45.489415 (+ 183us) server_negotiation.cc:407] Connection header received
0808 02:38:45.489677 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:45.489680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:45.489745 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:45.489822 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:45.491269 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.492053 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.495027 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.495589 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.495765 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.502352 (+ 6587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:52075: BlockingRecv error: recv got EOF from 127.10.20.66:52075 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:45.514019 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:45.503427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:41817)
0808 02:38:45.503601 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:45.503627 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:45.503754 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:45.504511 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:45.504514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:45.504826 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:45.505036 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.505046 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.506212 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.506220 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.507448 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.507462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.508293 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.508299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.508488 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.509375 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:45.509401 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.513712 (+ 4311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 02:38:45.514232 19914 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:45.503804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:41817 (local address 127.10.20.126:46391)
0808 02:38:45.504051 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:45.504061 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:45.504087 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:38:45.504171 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:45.504179 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:45.504313 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:45.504481 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:45.505192 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.506057 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.507665 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.508115 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.508265 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.513937 (+ 5672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:41817: BlockingRecv error: recv got EOF from 127.10.20.66:41817 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 02:38:45.514660 19912 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:38:45.762638 20052 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.226s user 0.013s sys 0.008s
W20260808 02:38:45.764150 20051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:44.513199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:39479 (local address 127.10.20.126:46391)
0808 02:38:44.515419 (+ 2220us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:44.515429 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:44.522748 (+ 7319us) server_negotiation.cc:407] Connection header received
0808 02:38:44.525131 (+ 2383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:44.525136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:44.525201 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:44.525280 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:44.528778 (+ 3498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.530120 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.533685 (+ 3565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.534487 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.534617 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.763814 (+1229197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:39479: BlockingRecv error: recv got EOF from 127.10.20.67:39479 (error 108)
Metrics: {"mutex_wait_us":125,"server-negotiator.queue_time_us":2013,"thread_start_us":2078,"threads_started":1}
I20260808 02:38:45.764678 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:44.514867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:39479)
0808 02:38:44.518835 (+ 3968us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:44.518934 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:44.522318 (+ 3384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:44.526265 (+ 3947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:44.526282 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:44.527382 (+ 1100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:44.528470 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:44.528522 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.530376 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.530383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:44.533434 (+ 3051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:44.533458 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:44.535247 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:44.535257 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:44.535647 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:44.536432 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:44.536472 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.763523 (+1227051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":3492,"thread_start_us":9011,"threads_started":1}
W20260808 02:38:45.765664 20049 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:46391 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.20.126:46391: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:45.776674 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:45.766459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:53293)
0808 02:38:45.766751 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:45.766775 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:45.766917 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:45.767331 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:45.767336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:45.767814 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:45.768007 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.768017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.769318 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.769322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.770538 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.770551 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.771451 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.771456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.771597 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.772250 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:45.772269 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.776362 (+ 4093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260808 02:38:45.776916 20051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:45.766585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:53293 (local address 127.10.20.126:46391)
0808 02:38:45.766828 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:45.766840 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:45.766863 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:38:45.767098 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:45.767103 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:45.767171 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:45.767297 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:45.768167 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.769097 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.770775 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.771273 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.771383 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.776626 (+ 5243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:53293: BlockingRecv error: recv got EOF from 127.10.20.67:53293 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:45.787261 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:45.777535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:40555)
0808 02:38:45.777724 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:45.777742 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:45.777850 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:45.778278 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:45.778282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:45.778635 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:45.778917 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.778928 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.780031 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.780035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.781037 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.781050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.781746 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.781751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.782071 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.782779 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:45.782798 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.786882 (+ 4084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 02:38:45.787626 20049 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:38:45.787894 20051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:45.777625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:40555 (local address 127.10.20.126:46391)
0808 02:38:45.777919 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:45.777924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:45.777938 (+ 14us) server_negotiation.cc:407] Connection header received
0808 02:38:45.777979 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:45.777982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:45.778099 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:45.778181 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:45.779077 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.779792 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.781179 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.781597 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.781691 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.787266 (+ 5575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:40555: BlockingRecv error: recv got EOF from 127.10.20.67:40555 (error 108)
Metrics: {"server-negotiator.queue_time_us":158}
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:45 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:45.987725 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:45.975638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:36589)
0808 02:38:45.976394 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:45.976414 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:45.976567 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:45.977090 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:45.977096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:45.977639 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:45.977812 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.977821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.979114 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.979121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.980313 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:45.980328 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.981620 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.981625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:45.981761 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.982460 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:45.982479 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:45.987454 (+ 4975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":382,"threads_started":1}
W20260808 02:38:45.988201 20051 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:45.975805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:36589 (local address 127.10.20.126:46391)
0808 02:38:45.976148 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:45.976154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:45.976533 (+ 379us) server_negotiation.cc:407] Connection header received
0808 02:38:45.976698 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:45.976702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:45.976794 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:45.976900 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:45.977999 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.978922 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.980566 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:45.981341 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:45.981476 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:45.987818 (+ 6342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:36589: BlockingRecv error: recv got EOF from 127.10.20.65:36589 (error 108)
Metrics: {"server-negotiator.queue_time_us":158}
Aug 08 02:38:46 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:46 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:46.526005 20058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:46.515483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:58987)
0808 02:38:46.516063 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:46.516081 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:46.516195 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:46.516724 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:46.516729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:46.517194 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:46.517355 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:46.517364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.518581 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.518586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:46.519892 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:46.519907 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.520792 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.520799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:46.521010 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:46.521708 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:46.521735 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:46.525753 (+ 4018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":273,"threads_started":1}
W20260808 02:38:46.526443 20059 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:46.515631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:58987 (local address 127.10.20.126:46391)
0808 02:38:46.516365 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:46.516370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:46.516389 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:38:46.516445 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:46.516449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:46.516514 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:46.516618 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:46.517533 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.518416 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.520087 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.520569 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.520697 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:46.526163 (+ 5466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:58987: BlockingRecv error: recv got EOF from 127.10.20.66:58987 (error 108)
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":487,"threads_started":1}
Aug 08 02:38:46 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:46 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:46.800025 20060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:46.788434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:44199)
0808 02:38:46.789217 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:46.789242 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:46.789543 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:46.789985 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:46.789990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:46.790446 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:46.790741 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:46.790756 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.792200 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.792206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:46.793612 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:46.793626 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.794511 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.794516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:46.794655 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:46.795472 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:46.795498 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:46.799742 (+ 4244us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":478,"threads_started":1}
W20260808 02:38:46.800329 20059 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:46.788776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44199 (local address 127.10.20.126:46391)
0808 02:38:46.789125 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:46.789132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:46.789397 (+ 265us) server_negotiation.cc:407] Connection header received
0808 02:38:46.789716 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:46.789721 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:46.789801 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:46.789897 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:46.790914 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.792035 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.793777 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.794255 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.794371 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:46.800034 (+ 5663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:44199: BlockingRecv error: recv got EOF from 127.10.20.67:44199 (error 108)
Metrics: {"server-negotiator.queue_time_us":157}
Aug 08 02:38:46 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:46 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:46.998991 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:46.988915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:46235)
0808 02:38:46.989533 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:46.989550 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:46.989722 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:46.990240 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:46.990245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:46.990720 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:46.990934 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:46.990943 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.991999 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.992005 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:46.992933 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:46.992945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.993708 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.993714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:46.993895 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:46.994523 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:46.994541 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:46.998581 (+ 4040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":345,"threads_started":1}
W20260808 02:38:46.999184 20059 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:46.989052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:46235 (local address 127.10.20.126:46391)
0808 02:38:46.989318 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:46.989327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:46.989648 (+ 321us) server_negotiation.cc:407] Connection header received
0808 02:38:46.989936 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:46.989942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:46.990037 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:46.990165 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:46.991081 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.991838 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.993082 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:46.993539 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:46.993678 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:46.998888 (+ 5210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:46235: BlockingRecv error: recv got EOF from 127.10.20.65:46235 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 08 02:38:47 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:47 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:47.544421 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:47.527237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:34145)
0808 02:38:47.528980 (+ 1743us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:47.529001 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:47.529194 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:47.535520 (+ 6326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:47.535527 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:47.536137 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:47.536337 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:47.536348 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.537465 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.537470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:47.538470 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:47.538484 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.539442 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.539447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:47.539600 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:47.540293 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:47.540313 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:47.544122 (+ 3809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1607,"thread_start_us":1445,"threads_started":1}
W20260808 02:38:47.544737 20063 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:47.527441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:34145 (local address 127.10.20.126:46391)
0808 02:38:47.535056 (+ 7615us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:47.535061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:47.535078 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:38:47.535160 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:47.535165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:47.535269 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:47.535400 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:47.536494 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.537301 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.538632 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.539228 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.539371 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:47.544396 (+ 5025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:34145: BlockingRecv error: recv got EOF from 127.10.20.66:34145 (error 108)
Metrics: {"server-negotiator.queue_time_us":7490,"thread_start_us":7330,"threads_started":1}
Aug 08 02:38:47 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:47 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:47.816581 20064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:47.801186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:39449)
0808 02:38:47.801852 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:47.801889 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:47.802071 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:47.802483 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:47.802489 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:47.803053 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:47.803258 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:47.803268 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.804387 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.804394 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:47.805433 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:47.805447 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.806291 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.806297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:47.806526 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:47.812318 (+ 5792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:47.812344 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:47.816308 (+ 3964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":380,"threads_started":1}
W20260808 02:38:47.817122 20063 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:47.801544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:39449 (local address 127.10.20.126:46391)
0808 02:38:47.801802 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:47.801809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:47.801985 (+ 176us) server_negotiation.cc:407] Connection header received
0808 02:38:47.802252 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:47.802258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:47.802327 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:47.802446 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:47.803422 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.804237 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.805618 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:47.806115 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:47.806268 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:47.816650 (+ 10382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:39449: BlockingRecv error: recv got EOF from 127.10.20.67:39449 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 08 02:38:48 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:48 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:48.012284 20066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:48.000461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:53663)
0808 02:38:48.001032 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:48.001049 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:48.001184 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:48.001659 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:48.001663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:48.002103 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:48.002291 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:48.002301 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.003699 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.003704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:48.005046 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:48.005069 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.006607 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.006616 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:48.006898 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:48.007774 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:48.007821 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:48.012018 (+ 4197us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":301,"threads_started":1}
W20260808 02:38:48.012699 20063 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:48.000584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:53663 (local address 127.10.20.126:46391)
0808 02:38:48.000821 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:48.000826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:48.001177 (+ 351us) server_negotiation.cc:407] Connection header received
0808 02:38:48.001338 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:48.001343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:48.001450 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:48.001574 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:48.002486 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.003508 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.005364 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.006147 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.006511 (+ 364us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:48.012358 (+ 5847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:53663: BlockingRecv error: recv got EOF from 127.10.20.65:53663 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 02:38:48 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:48 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:48.557499 20067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:48.545847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:55465)
0808 02:38:48.546856 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:48.546881 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:48.547087 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:48.547701 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:48.547706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:48.548257 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:48.548449 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:48.548460 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.550138 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.550144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:48.551288 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:48.551305 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.552106 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.552111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:48.552268 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:48.552993 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:48.553015 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:48.557226 (+ 4211us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":286,"threads_started":1}
W20260808 02:38:48.557876 20068 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:48.546071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:55465 (local address 127.10.20.126:46391)
0808 02:38:48.546811 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:48.546820 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:48.546988 (+ 168us) server_negotiation.cc:407] Connection header received
0808 02:38:48.547235 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:48.547247 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:48.547356 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:48.547476 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:48.548657 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.549762 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.551470 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.551933 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.552053 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:48.557565 (+ 5512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:55465: BlockingRecv error: recv got EOF from 127.10.20.66:55465 (error 108)
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":439,"threads_started":1}
Aug 08 02:38:48 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:48 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:48.829998 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:48.817855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:34709)
0808 02:38:48.818505 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:48.818535 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:48.818703 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:48.819174 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:48.819179 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:48.819729 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:48.819963 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:48.819978 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.821597 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.821602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:48.822964 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:48.822986 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.824076 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.824083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:48.824300 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:48.825074 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:48.825095 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:48.829670 (+ 4575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":383,"threads_started":1}
W20260808 02:38:48.830322 20068 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:48.818111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:34709 (local address 127.10.20.126:46391)
0808 02:38:48.818345 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:48.818350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:48.818831 (+ 481us) server_negotiation.cc:407] Connection header received
0808 02:38:48.818908 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:48.818912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:48.818981 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:48.819079 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:48.820191 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.821302 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.823163 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:48.823807 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:48.824024 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:48.830042 (+ 6018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:34709: BlockingRecv error: recv got EOF from 127.10.20.67:34709 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 08 02:38:49 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:49 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:49.026144 20070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:49.013694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:60719)
0808 02:38:49.014489 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:49.014508 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:49.014753 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:49.015194 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:49.015199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:49.015670 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:49.015871 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:49.015882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.017003 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.017010 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:49.018890 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:49.019074 (+ 184us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.019972 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.019978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:49.020186 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:49.020882 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:49.020903 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:49.025737 (+ 4834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":469,"threads_started":1}
W20260808 02:38:49.026517 20068 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:49.013841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:60719 (local address 127.10.20.126:46391)
0808 02:38:49.014247 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:49.014254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:49.014624 (+ 370us) server_negotiation.cc:407] Connection header received
0808 02:38:49.014929 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:49.014935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:49.015037 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:49.015155 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:49.016041 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.016838 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.019272 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.019792 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.019946 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:49.026131 (+ 6185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:60719: BlockingRecv error: recv got EOF from 127.10.20.65:60719 (error 108)
Metrics: {"server-negotiator.queue_time_us":212}
Aug 08 02:38:49 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:49 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:49.570914 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:49.558732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:60371)
0808 02:38:49.559328 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:49.559347 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:49.559470 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:49.559839 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:49.559843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:49.560299 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:49.560475 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:49.560485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.562110 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.562115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:49.563305 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:49.563322 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.564239 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.564246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:49.564504 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:49.565344 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:49.565376 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:49.570432 (+ 5056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":354,"threads_started":1}
W20260808 02:38:49.571331 20073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:49.558844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:60371 (local address 127.10.20.126:46391)
0808 02:38:49.559455 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:49.559460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:49.559480 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:38:49.559583 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:49.559587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:49.559650 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:49.559757 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:49.560671 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.561759 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.563515 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.564021 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.564149 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:49.570903 (+ 6754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:60371: BlockingRecv error: recv got EOF from 127.10.20.66:60371 (error 108)
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":386,"threads_started":1}
Aug 08 02:38:49 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:49 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:49.843226 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:49.831407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:44859)
0808 02:38:49.832135 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:49.832159 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:49.832323 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:49.832704 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:49.832709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:49.833147 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:49.833325 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:49.833334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.834914 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.834921 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:49.836245 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:49.836264 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.837212 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.837220 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:49.837516 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:49.838301 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:49.838321 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:49.842761 (+ 4440us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":421,"threads_started":1}
W20260808 02:38:49.843385 20073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:49.831505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44859 (local address 127.10.20.126:46391)
0808 02:38:49.831813 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:49.831820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:49.832253 (+ 433us) server_negotiation.cc:407] Connection header received
0808 02:38:49.832460 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:49.832465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:49.832540 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:49.832649 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:49.833535 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.834661 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.836455 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:49.837004 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:49.837165 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:49.843055 (+ 5890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:44859: BlockingRecv error: recv got EOF from 127.10.20.67:44859 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 02:38:50 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:50 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:50.039496 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:50.027448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:45677)
0808 02:38:50.028011 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:50.028029 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:50.028158 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:50.028621 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:50.028625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:50.029119 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:50.029511 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:50.029522 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.031151 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.031156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:50.032160 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:50.032175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.033116 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.033122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:50.033279 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:50.034286 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:50.034306 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:50.039211 (+ 4905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":297,"threads_started":1}
W20260808 02:38:50.039887 20073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:50.027555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:45677 (local address 127.10.20.126:46391)
0808 02:38:50.027764 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:50.027769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:50.028148 (+ 379us) server_negotiation.cc:407] Connection header received
0808 02:38:50.028268 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:50.028273 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:50.028420 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:50.028540 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:50.029739 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.030847 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.032388 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.032905 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.033042 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:50.039462 (+ 6420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:45677: BlockingRecv error: recv got EOF from 127.10.20.65:45677 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 02:38:50 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:50 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:50.584801 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:50.572127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:51275)
0808 02:38:50.572809 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:50.572834 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:50.572995 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:50.573505 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:50.573511 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:50.574104 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:50.574261 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:50.574270 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.575773 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.575777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:50.576874 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:50.576891 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.578199 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.578208 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:50.578467 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:50.579360 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:50.579381 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:50.584404 (+ 5023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":346,"threads_started":1}
W20260808 02:38:50.584993 20077 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:50.572468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:51275 (local address 127.10.20.126:46391)
0808 02:38:50.573075 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:50.573080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:50.573124 (+ 44us) server_negotiation.cc:407] Connection header received
0808 02:38:50.573195 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:50.573200 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:50.573291 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:50.573418 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:50.574427 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.575567 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.577246 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.577956 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.578162 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:50.584666 (+ 6504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:51275: BlockingRecv error: recv got EOF from 127.10.20.66:51275 (error 108)
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":371,"threads_started":1}
Aug 08 02:38:50 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:50 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:50.856513 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:50.844542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:56133)
0808 02:38:50.845184 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:50.845210 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:50.845356 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:50.845756 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:50.845760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:50.846250 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:50.846429 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:50.846439 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.848194 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.848198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:50.849492 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:50.849514 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.850773 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.850780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:50.851046 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:50.851783 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:50.851803 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:50.856211 (+ 4408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":350,"threads_started":1}
W20260808 02:38:50.856768 20077 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:50.844772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:56133 (local address 127.10.20.126:46391)
0808 02:38:50.845013 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:50.845019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:50.845309 (+ 290us) server_negotiation.cc:407] Connection header received
0808 02:38:50.845475 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:50.845485 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:50.845555 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:50.845653 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:50.846626 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.847781 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.849754 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:50.850485 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:50.850736 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:50.856498 (+ 5762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:56133: BlockingRecv error: recv got EOF from 127.10.20.67:56133 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 08 02:38:51 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:51 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:38:51.052280 20077 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:51.040780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:51739 (local address 127.10.20.126:46391)
0808 02:38:51.040978 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:51.040984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:51.041313 (+ 329us) server_negotiation.cc:407] Connection header received
0808 02:38:51.041581 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:51.041586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:51.041655 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:51.041749 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:51.042778 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.043575 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.044915 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.045370 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.045472 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:51.051987 (+ 6515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:51739: BlockingRecv error: recv got EOF from 127.10.20.65:51739 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:38:51.052172 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:51.040650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:51739)
0808 02:38:51.041206 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:51.041223 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:51.041365 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:51.041839 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:51.041844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:51.042349 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:51.042573 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:51.042584 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.043732 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.043736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:51.044747 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:51.044763 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.045546 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.045551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:51.045699 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:51.046344 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:51.046365 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:51.051741 (+ 5376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":304,"threads_started":1}
Aug 08 02:38:51 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:51 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:51.598276 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:51.586281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:46347)
0808 02:38:51.587379 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:51.587398 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:51.587540 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:51.588101 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:51.588115 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:51.588590 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:51.588803 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:51.588813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.590037 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.590042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:51.591397 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:51.591413 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.592289 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.592295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:51.592446 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:51.593196 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:51.593215 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:51.597846 (+ 4631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":979,"thread_start_us":846,"threads_started":1}
W20260808 02:38:51.598888 20081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:51.586256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:46347 (local address 127.10.20.126:46391)
0808 02:38:51.586984 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:51.586989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:51.587504 (+ 515us) server_negotiation.cc:407] Connection header received
0808 02:38:51.587636 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:51.587639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:51.587900 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:51.588035 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:51.589052 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.589851 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.591582 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.592080 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.592200 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:51.598442 (+ 6242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:46347: BlockingRecv error: recv got EOF from 127.10.20.66:46347 (error 108)
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":447,"threads_started":1}
Aug 08 02:38:51 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:51 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:51.868829 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:51.857823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:48839)
0808 02:38:51.858399 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:51.858422 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:51.858564 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:51.858975 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:51.858979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:51.859420 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:51.859657 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:51.859669 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.860813 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.860818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:51.861829 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:51.861844 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.863079 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.863085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:51.863294 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:51.864130 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:51.864162 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:51.868405 (+ 4243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":359,"threads_started":1}
W20260808 02:38:51.868930 20081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:51.858068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:48839 (local address 127.10.20.126:46391)
0808 02:38:51.858337 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:51.858344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:51.858521 (+ 177us) server_negotiation.cc:407] Connection header received
0808 02:38:51.858752 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:51.858757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:51.858826 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:51.858928 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:51.859824 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.860616 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.862160 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:51.862787 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:51.863058 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:51.868685 (+ 5627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:48839: BlockingRecv error: recv got EOF from 127.10.20.67:48839 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 08 02:38:52 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:52 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:52.065081 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:52.053548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:59391)
0808 02:38:52.054378 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:52.054396 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:52.054585 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:52.055041 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:52.055127 (+ 86us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:52.055650 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:52.055854 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:52.055864 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.057014 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.057021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:52.058013 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:52.058026 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.058869 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.058876 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:52.059058 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:52.059750 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:52.059769 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:52.064776 (+ 5007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":345,"threads_started":1}
W20260808 02:38:52.065305 20081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:52.053733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:59391 (local address 127.10.20.126:46391)
0808 02:38:52.054082 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:52.054092 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:52.054512 (+ 420us) server_negotiation.cc:407] Connection header received
0808 02:38:52.054784 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:52.054789 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:52.054867 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:52.054995 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:52.056045 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.056828 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.058180 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.058644 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.058825 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:52.065027 (+ 6202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:59391: BlockingRecv error: recv got EOF from 127.10.20.65:59391 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 08 02:38:52 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:52 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:52.611726 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:52.599548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:45907)
0808 02:38:52.600247 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:52.600266 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:52.600386 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:52.600872 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:52.600881 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:52.601585 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:52.602007 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:52.602025 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.603480 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.603485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:52.604632 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:52.604648 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.605652 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.605663 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:52.605841 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:52.606584 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:52.606604 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:52.611329 (+ 4725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":346,"threads_started":1}
W20260808 02:38:52.611975 20085 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:52.599679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:45907 (local address 127.10.20.126:46391)
0808 02:38:52.600311 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:52.600318 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:52.600341 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:38:52.600523 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:52.600528 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:52.600633 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:52.600769 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:52.602199 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.603303 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.604822 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.605421 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.605578 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:52.611607 (+ 6029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:45907: BlockingRecv error: recv got EOF from 127.10.20.66:45907 (error 108)
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":311,"threads_started":1}
Aug 08 02:38:52 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:52 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:52.886032 20086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:52.870065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:44981)
0808 02:38:52.870850 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:52.870873 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:52.871053 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:52.871529 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:52.871534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:52.872086 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:52.872312 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:52.872323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.873429 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.873435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:52.874651 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:52.874727 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.875614 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.875620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:52.875791 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:52.881134 (+ 5343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:52.881162 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:52.885658 (+ 4496us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":328,"threads_started":1}
W20260808 02:38:52.886219 20085 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:52.870225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44981 (local address 127.10.20.126:46391)
0808 02:38:52.870485 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:52.870493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:52.870972 (+ 479us) server_negotiation.cc:407] Connection header received
0808 02:38:52.871194 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:52.871200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:52.871331 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:52.871486 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:52.872479 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.873271 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.874860 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:52.875440 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:52.875605 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:52.885965 (+ 10360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:44981: BlockingRecv error: recv got EOF from 127.10.20.67:44981 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 02:38:53 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:53 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:53.077301 20087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:53.066439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:40319)
0808 02:38:53.067089 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:53.067112 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:53.067251 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:53.067626 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:53.067629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:53.068061 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:53.068237 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:53.068245 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.069408 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.069413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:53.070975 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:53.070998 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.072086 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.072094 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:53.072256 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:53.072869 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:53.072887 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:53.077033 (+ 4146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":356,"threads_started":1}
W20260808 02:38:53.077574 20085 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:53.066793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:40319 (local address 127.10.20.126:46391)
0808 02:38:53.066998 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:53.067004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:53.067234 (+ 230us) server_negotiation.cc:407] Connection header received
0808 02:38:53.067369 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:53.067373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:53.067475 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:53.067575 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:53.068418 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.069228 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.071155 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.071763 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.071899 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:53.077303 (+ 5404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:40319: BlockingRecv error: recv got EOF from 127.10.20.65:40319 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 02:38:53 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:53 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:53.625208 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:53.613218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:47829)
0808 02:38:53.613834 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:53.613851 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:53.613976 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:53.614310 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:53.614313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:53.614880 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:53.615083 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:53.615093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.616451 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.616455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:53.617442 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:53.617455 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.618433 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.618439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:53.618574 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:53.619745 (+ 1171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:53.619766 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:53.624806 (+ 5040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":337,"threads_started":1}
W20260808 02:38:53.625368 20089 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:53.613332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:47829 (local address 127.10.20.126:46391)
0808 02:38:53.613853 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:53.613857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:53.613961 (+ 104us) server_negotiation.cc:407] Connection header received
0808 02:38:53.614082 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:53.614086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:53.614160 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:53.614257 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:53.615273 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.616235 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.617676 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.618121 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.618363 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:53.625077 (+ 6714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:47829: BlockingRecv error: recv got EOF from 127.10.20.66:47829 (error 108)
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":304,"threads_started":1}
Aug 08 02:38:53 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:53 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:53.899292 20090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:53.887350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:35269)
0808 02:38:53.888193 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:53.888215 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:53.888414 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:53.888811 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:53.888816 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:53.889318 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:53.889500 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:53.889512 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.891083 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.891098 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:53.892234 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:53.892252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.893207 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.893215 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:53.893422 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:53.894316 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:53.894343 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:53.898904 (+ 4561us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":482,"threads_started":1}
W20260808 02:38:53.899395 20089 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:53.887680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:35269 (local address 127.10.20.126:46391)
0808 02:38:53.887975 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:53.887983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:53.888327 (+ 344us) server_negotiation.cc:407] Connection header received
0808 02:38:53.888575 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:53.888581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:53.888656 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:53.888769 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:53.889671 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.890884 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.892459 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:53.892960 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:53.893130 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:53.899154 (+ 6024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:35269: BlockingRecv error: recv got EOF from 127.10.20.67:35269 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 08 02:38:54 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:54 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:54.089103 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:54.078670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:37095)
0808 02:38:54.079380 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:54.079397 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:54.079519 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:54.079815 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:54.079818 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:54.080287 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:54.080443 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:54.080452 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.081584 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.081588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:54.082813 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:54.082829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.083700 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.083705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:54.083871 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:54.084640 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:54.084661 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:54.088833 (+ 4172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":394,"threads_started":1}
W20260808 02:38:54.089534 20089 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:54.078756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:37095 (local address 127.10.20.126:46391)
0808 02:38:54.079009 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:54.079015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:54.079481 (+ 466us) server_negotiation.cc:407] Connection header received
0808 02:38:54.079606 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:54.079609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:54.079685 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:54.079768 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:54.080624 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.081420 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.082997 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.083499 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.083616 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:54.089230 (+ 5614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:37095: BlockingRecv error: recv got EOF from 127.10.20.65:37095 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 02:38:54 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:54 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:54.638190 20092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:54.626501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:43541)
0808 02:38:54.627156 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:54.627174 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:54.627291 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:54.627781 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:54.627784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:54.628320 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:54.628478 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:54.628487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.629817 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.629823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:54.631062 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:54.631079 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.632202 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.632207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:54.632367 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:54.633123 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:54.633145 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:54.637947 (+ 4802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":322,"threads_started":1}
W20260808 02:38:54.638550 20093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:54.626609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:43541 (local address 127.10.20.126:46391)
0808 02:38:54.627453 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:54.627459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:54.627478 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:38:54.627533 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:54.627538 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:54.627624 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:54.627719 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:54.628639 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.629628 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.631257 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.631979 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.632113 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:54.638212 (+ 6099us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:43541: BlockingRecv error: recv got EOF from 127.10.20.66:43541 (error 108)
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":588,"threads_started":1}
Aug 08 02:38:54 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:54 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:54.911499 20095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:54.900580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:36921)
0808 02:38:54.901141 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:54.901166 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:54.901297 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:54.901740 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:54.901744 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:54.902307 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:54.902502 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:54.902514 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.903658 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.903662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:54.904748 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:54.904762 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.905595 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.905600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:54.905741 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:54.906617 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:54.906638 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:54.911175 (+ 4537us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":302,"threads_started":1}
W20260808 02:38:54.912168 20093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:54.900699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:36921 (local address 127.10.20.126:46391)
0808 02:38:54.900969 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:54.900976 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:54.901259 (+ 283us) server_negotiation.cc:407] Connection header received
0808 02:38:54.901406 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:54.901410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:54.901474 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:54.901575 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:54.902661 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.903485 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.904927 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:54.905405 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:54.905552 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:54.911553 (+ 6001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:36921: BlockingRecv error: recv got EOF from 127.10.20.67:36921 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 08 02:38:55 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:55 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:55.102388 20096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:55.090556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:56903)
0808 02:38:55.091193 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:55.091211 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:55.091352 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:55.091805 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:55.091809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:55.092242 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:55.092422 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:55.092432 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.093820 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.093827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:55.095728 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:55.095750 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.096945 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.096950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:55.097100 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:55.097797 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:55.097818 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:55.102110 (+ 4292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":372,"threads_started":1}
W20260808 02:38:55.102769 20093 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:55.090786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:56903 (local address 127.10.20.126:46391)
0808 02:38:55.091213 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:55.091217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:55.091312 (+ 95us) server_negotiation.cc:407] Connection header received
0808 02:38:55.091480 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:55.091484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:55.091577 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:55.091676 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:55.092703 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.093563 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.095938 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.096724 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.096836 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:55.102391 (+ 5555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:56903: BlockingRecv error: recv got EOF from 127.10.20.65:56903 (error 108)
Metrics: {"server-negotiator.queue_time_us":299}
Aug 08 02:38:55 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:55 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:55.651365 20097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:55.639488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:43327)
0808 02:38:55.640136 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:55.640167 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:55.640297 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:55.640668 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:55.640672 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:55.641082 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:55.641248 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:55.641257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.642488 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.642494 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:55.643771 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:55.643789 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.644999 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.645008 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:55.645207 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:55.646261 (+ 1054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:55.646281 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:55.651082 (+ 4801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":358,"threads_started":1}
W20260808 02:38:55.651708 20098 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:55.639604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:43327 (local address 127.10.20.126:46391)
0808 02:38:55.640220 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:55.640226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:55.640248 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:38:55.640418 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:55.640422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:55.640501 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:55.640610 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:55.641485 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.642292 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.643965 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.644543 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.644691 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:55.651424 (+ 6733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:43327: BlockingRecv error: recv got EOF from 127.10.20.66:43327 (error 108)
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":377,"threads_started":1}
Aug 08 02:38:55 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:55 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:55.924628 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:55.912716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:49703)
0808 02:38:55.913346 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:55.913369 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:55.913516 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:55.913962 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:55.913968 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:55.914467 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:55.914667 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:55.914718 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.916343 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.916348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:55.917500 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:55.917519 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.918463 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.918469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:55.918739 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:55.919564 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:55.919586 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:55.924352 (+ 4766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":360,"threads_started":1}
W20260808 02:38:55.924791 20098 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:55.912910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:49703 (local address 127.10.20.126:46391)
0808 02:38:55.913137 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:55.913142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:55.913612 (+ 470us) server_negotiation.cc:407] Connection header received
0808 02:38:55.913680 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:55.913683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:55.913752 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:55.913840 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:55.914945 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.916128 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.917701 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:55.918207 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:55.918445 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:55.924592 (+ 6147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:49703: BlockingRecv error: recv got EOF from 127.10.20.67:49703 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 08 02:38:56 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:56 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:56.115896 20100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:56.103694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:39195)
0808 02:38:56.104383 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:56.104400 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:56.104598 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:56.105020 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:56.105025 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:56.105643 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:56.105879 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:56.105891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.107384 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.107390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:56.108847 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:56.108863 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.109645 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.109652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:56.109854 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:56.110614 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:56.110634 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:56.115508 (+ 4874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":344,"threads_started":1}
W20260808 02:38:56.116096 20098 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:56.103901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:39195 (local address 127.10.20.126:46391)
0808 02:38:56.104203 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:56.104211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:56.104512 (+ 301us) server_negotiation.cc:407] Connection header received
0808 02:38:56.104746 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:56.104752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:56.104859 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:56.104986 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:56.106059 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.107216 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.109009 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.109464 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.109625 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:56.115784 (+ 6159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:39195: BlockingRecv error: recv got EOF from 127.10.20.65:39195 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 08 02:38:56 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:56 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:56.663461 20101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:56.652749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:57431)
0808 02:38:56.653315 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:56.653352 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:56.653497 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:56.653877 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:56.653882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:56.654349 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:56.654536 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:56.654545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.655666 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.655674 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:56.656614 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:56.656626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.657410 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.657417 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:56.657607 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:56.658440 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:56.658460 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:56.663102 (+ 4642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":281,"threads_started":1}
W20260808 02:38:56.663623 20102 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:56.652936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:57431 (local address 127.10.20.126:46391)
0808 02:38:56.653556 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:56.653564 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:56.653584 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:38:56.653647 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:56.653650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:56.653721 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:56.653848 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:56.654720 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.655522 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.656769 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.657233 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.657373 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:56.663310 (+ 5937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:57431: BlockingRecv error: recv got EOF from 127.10.20.66:57431 (error 108)
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":384,"threads_started":1}
Aug 08 02:38:56 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:56 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:56.937732 20103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:56.925824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:53481)
0808 02:38:56.926414 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:56.926438 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:56.926569 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:56.927100 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:56.927105 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:56.927663 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:56.927986 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:56.928004 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.929380 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.929385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:56.930433 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:56.930450 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.931446 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.931451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:56.931620 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:56.932548 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:56.932570 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:56.937399 (+ 4829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":347,"threads_started":1}
W20260808 02:38:56.937938 20102 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:56.926121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:53481 (local address 127.10.20.126:46391)
0808 02:38:56.926315 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:56.926320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:56.926571 (+ 251us) server_negotiation.cc:407] Connection header received
0808 02:38:56.926669 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:56.926706 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:56.926796 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:56.926930 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:56.928174 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.929207 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.930632 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:56.931240 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:56.931359 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:56.937730 (+ 6371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:53481: BlockingRecv error: recv got EOF from 127.10.20.67:53481 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 02:38:57 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:57 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:57.128202 20104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:57.117329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:34717)
0808 02:38:57.117992 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:57.118010 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:57.118147 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:57.118583 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:57.118589 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:57.119327 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:57.119545 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:57.119556 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.120745 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.120750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:57.121933 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:57.121953 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.123160 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.123170 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:57.123346 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:57.124102 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:57.124123 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:57.127918 (+ 3795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":341,"threads_started":1}
W20260808 02:38:57.128510 20102 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:57.117464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:34717 (local address 127.10.20.126:46391)
0808 02:38:57.117731 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:57.117737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:57.118141 (+ 404us) server_negotiation.cc:407] Connection header received
0808 02:38:57.118271 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:57.118276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:57.118348 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:57.118445 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:57.119758 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.120549 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.122160 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.122906 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.123098 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:57.128232 (+ 5134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:34717: BlockingRecv error: recv got EOF from 127.10.20.65:34717 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 08 02:38:57 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:57 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:57.678416 20105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:57.664811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:48675)
0808 02:38:57.665496 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:57.665514 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:57.665656 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:57.666462 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:57.666468 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:57.666952 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:57.667146 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:57.667156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.668636 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.668642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:57.670228 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:57.670295 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.671796 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.671874 (+ 78us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:57.672112 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:57.673064 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:57.673090 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:57.678134 (+ 5044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":350,"threads_started":1}
W20260808 02:38:57.678845 20106 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:57.664960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:48675 (local address 127.10.20.126:46391)
0808 02:38:57.665509 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:57.665515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:57.665641 (+ 126us) server_negotiation.cc:407] Connection header received
0808 02:38:57.665940 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:57.665945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:57.666011 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:57.666120 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:57.667466 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.668366 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.670539 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.671537 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.671693 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:57.678430 (+ 6737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:48675: BlockingRecv error: recv got EOF from 127.10.20.66:48675 (error 108)
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":317,"threads_started":1}
Aug 08 02:38:57 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:57 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:57.954751 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:57.939174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:49469)
0808 02:38:57.939893 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:57.939927 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:57.940087 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:57.940555 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:57.940560 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:57.941121 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:57.941396 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:57.941410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.942925 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.942931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:57.943935 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:57.943950 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.944764 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.944770 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:57.944982 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:57.950221 (+ 5239us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:57.950248 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:57.954381 (+ 4133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":392,"threads_started":1}
W20260808 02:38:57.955005 20106 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:57.939459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:49469 (local address 127.10.20.126:46391)
0808 02:38:57.939670 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:57.939676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:57.940061 (+ 385us) server_negotiation.cc:407] Connection header received
0808 02:38:57.940232 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:57.940238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:57.940321 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:57.940440 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:57.941616 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.942766 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.944116 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:57.944552 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:57.944702 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:57.954664 (+ 9962us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:49469: BlockingRecv error: recv got EOF from 127.10.20.67:49469 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 02:38:58 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:58 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 02:38:58.140177 20108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:58.129715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:34579)
0808 02:38:58.130289 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:58.130309 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:58.130479 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:58.130913 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:58.130917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:58.131361 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:58.131526 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:58.131535 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.132687 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.132692 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:58.133712 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:58.133728 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.134838 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.134844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:58.135070 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:58.135949 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:58.135975 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:58.139932 (+ 3957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":319,"threads_started":1}
W20260808 02:38:58.140571 20106 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:58.129918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:34579 (local address 127.10.20.126:46391)
0808 02:38:58.130217 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:58.130222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:58.130395 (+ 173us) server_negotiation.cc:407] Connection header received
0808 02:38:58.130613 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:58.130617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:58.130710 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:58.130847 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:58.131709 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.132495 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.133894 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.134511 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.134649 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:58.140200 (+ 5551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:34579: BlockingRecv error: recv got EOF from 127.10.20.65:34579 (error 108)
Metrics: {"server-negotiator.queue_time_us":163}
I20260808 02:38:59.527078 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19617
W20260808 02:38:59.540277 20111 sasl_common.cc:323] Time spent creating new SASL oryx client: real 0.576s user 0.001s sys 0.000s
W20260808 02:38:59.540328 20109 sasl_common.cc:323] Time spent creating new SASL oryx client: real 0.853s user 0.000s sys 0.001s
W20260808 02:38:59.540410 20113 sasl_common.cc:323] Time spent creating new SASL oryx client: real 0.393s user 0.001s sys 0.000s
Aug 08 02:38:59 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:59 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:59 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.66@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:59 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:59 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.67@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 02:38:59 dist-test-slave-8tdl krb5kdc[19002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.20.65@KRBTEST.COM for oryx/127.10.20.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 02:38:59.548110 20110 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:58.680042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:45233 (local address 127.10.20.126:46391)
0808 02:38:58.682179 (+ 2137us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:58.682185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:58.682204 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:38:58.682261 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:58.682265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:58.682351 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:58.682458 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:58.683833 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.684711 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.686605 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.687195 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.687317 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.547738 (+860421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.66:45233: BlockingRecv error: recv got EOF from 127.10.20.66:45233 (error 108)
Metrics: {"server-negotiator.queue_time_us":2014,"thread_start_us":1865,"threads_started":1}
I20260808 02:38:59.548410 20111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:58.956076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.67:60755)
0808 02:38:58.956777 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:58.956800 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:58.956944 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:58.957727 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:58.957734 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:58.958936 (+ 1202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:58.959399 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:58.959434 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.961148 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.961155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:58.962483 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:58.962511 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.963545 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.963553 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:58.963933 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.540463 (+576530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:59.540504 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:59.547983 (+ 7479us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":479,"threads_started":1}
W20260808 02:38:59.549736 20112 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:58.956415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:60755 (local address 127.10.20.126:46391)
0808 02:38:58.957253 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:58.957258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:58.957276 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:38:58.957333 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:58.957337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:58.957398 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:58.957507 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:58.959705 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.960879 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.962749 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.963348 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.963470 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.549383 (+585913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.67:60755: BlockingRecv error: recv got EOF from 127.10.20.67:60755 (error 108)
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":567,"threads_started":1}
I20260808 02:38:59.550043 20113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:59.141344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.65:57413)
0808 02:38:59.141939 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:59.141962 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:59.142138 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:59.142579 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:59.142583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:59.143045 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:59.143233 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:59.143243 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.144533 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.144538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:59.145673 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:59.145689 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.146584 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.146591 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:59.146829 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.540513 (+393684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:59.540547 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:59.549537 (+ 8990us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":260,"threads_started":1}
I20260808 02:38:59.551259 20109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:58.679753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46391 (local address 127.10.20.66:45233)
0808 02:38:58.681784 (+ 2031us) negotiation.cc:107] Waiting for socket to connect
0808 02:38:58.681828 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:38:58.682034 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:38:58.682552 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:38:58.682560 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:38:58.683355 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:38:58.683601 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:58.683616 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.684896 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.684902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:58.686397 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:38:58.686416 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:38:58.687385 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:38:58.687393 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:38:58.687588 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.540488 (+852900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:38:59.540527 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:38:59.550877 (+ 10350us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.20.126:46391: Server oryx/127.10.20.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1831,"thread_start_us":1674,"threads_started":1}
W20260808 02:38:59.551631 20114 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:38:59.141473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:57413 (local address 127.10.20.126:46391)
0808 02:38:59.142251 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:59.142256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:59.142273 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:38:59.142322 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:59.142326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:59.142394 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:59.142499 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:59.143452 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.144315 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.145867 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.146376 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.146495 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.551312 (+404817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.20.65:57413: BlockingRecv error: recv got EOF from 127.10.20.65:57413 (error 108)
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":415,"threads_started":1}
I20260808 02:38:59.552969 20116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:59.528431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48620 (local address 127.10.20.65:38487)
0808 02:38:59.529146 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:59.529154 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:59.529187 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:38:59.529251 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:59.529258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:59.529519 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:59.529698 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:59.531565 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.532884 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.534614 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.535578 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.535724 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.544380 (+ 8656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:59.544405 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:59.544429 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:59.544518 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:59.551875 (+ 7357us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.20.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 02:38:59.552566 (+ 691us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48620: Request ticket server kudu/127.10.20.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":351,"threads_started":1}
W20260808 02:38:59.553099 20116 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48620: Request ticket server kudu/127.10.20.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 02:38:59.553412 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19617: Not authorized: Client connection negotiation failed: client connection to 127.10.20.65:38487: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.20.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 02:38:59.553661 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19617
I20260808 02:38:59.581549 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19775
I20260808 02:38:59.598625 20117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:59.583466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.10.20.66:37579)
0808 02:38:59.584257 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:59.584268 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:59.584305 (+ 37us) server_negotiation.cc:407] Connection header received
0808 02:38:59.584392 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:59.584401 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:59.584748 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:59.584984 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:59.587197 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.588396 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.590553 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.591556 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.591744 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.594566 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:59.594576 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:59.594592 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:59.594647 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:59.598005 (+ 3358us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.20.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 02:38:59.598364 (+ 359us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43022: Request ticket server kudu/127.10.20.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":403,"threads_started":1}
W20260808 02:38:59.598802 20117 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43022: Request ticket server kudu/127.10.20.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 02:38:59.598914 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19775: Not authorized: Client connection negotiation failed: client connection to 127.10.20.66:37579: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.20.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 02:38:59.599195 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19775
I20260808 02:38:59.620131 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19916
I20260808 02:38:59.637554 20118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:38:59.623784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38776 (local address 127.10.20.67:38475)
0808 02:38:59.624558 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0808 02:38:59.624569 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:38:59.624612 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:38:59.624687 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:38:59.624695 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:38:59.624944 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:38:59.625125 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:38:59.626927 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.628084 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.629388 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:38:59.629983 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:38:59.630105 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:38:59.633288 (+ 3183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:38:59.633299 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:38:59.633320 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:38:59.633449 (+ 129us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:38:59.636938 (+ 3489us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.20.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 02:38:59.637286 (+ 348us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38776: Request ticket server kudu/127.10.20.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":388,"threads_started":1}
W20260808 02:38:59.637708 20118 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38776: Request ticket server kudu/127.10.20.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 02:38:59.637847 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19916: Not authorized: Client connection negotiation failed: client connection to 127.10.20.67:38475: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.20.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 02:38:59.638085 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19916
I20260808 02:38:59.659880 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 19547
I20260808 02:38:59.661379 19610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:38:59.792809 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 19547
2026-08-08T02:38:59Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22480 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T02:38:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:38:59Z Disabled control of system clock
I20260808 02:38:59.895730 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:45731
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:45071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:45731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 02:39:00.287855 20123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:00.288223 20123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:00.288311 20123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:00.296654 20123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:39:00.296825 20123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:00.296866 20123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:00.296921 20123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:39:00.296967 20123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:39:00.307077 20123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:45731
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:45731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:00.308477 20123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:00.310519 20123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:00.325222 20128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:00.325364 20131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:00.325446 20129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:00.326555 20123 server_base.cc:1034] running on GCE node
I20260808 02:39:00.327643 20123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:00.329365 20123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:00.330646 20123 hybrid_clock.cc:648] HybridClock initialized: now 1786156740330572 us; error 65 us; skew 500 ppm
I20260808 02:39:00.331375 20123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:00.334475 20123 webserver.cc:460] Webserver started at http://127.10.20.126:38713/ using document root <none> and password file <none>
I20260808 02:39:00.335433 20123 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:00.335582 20123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:00.335980 20123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:00.339763 20123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "c8ebd823727e4ab9a0517c534ca6835f"
format_stamp: "Formatted at 2026-08-08 02:39:00 on dist-test-slave-8tdl"
server_key: "38412c85a2fe402bcee7d22dbf369e78"
server_key_iv: "f9056adb51530857b35ac23ae3014cd8"
server_key_version: "encryptionkey@0"
I20260808 02:39:00.341058 20123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "c8ebd823727e4ab9a0517c534ca6835f"
format_stamp: "Formatted at 2026-08-08 02:39:00 on dist-test-slave-8tdl"
server_key: "38412c85a2fe402bcee7d22dbf369e78"
server_key_iv: "f9056adb51530857b35ac23ae3014cd8"
server_key_version: "encryptionkey@0"
I20260808 02:39:00.347654 20123 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:39:00.352212 20137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:00.354142 20123 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:39:00.354390 20123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "c8ebd823727e4ab9a0517c534ca6835f"
format_stamp: "Formatted at 2026-08-08 02:39:00 on dist-test-slave-8tdl"
server_key: "38412c85a2fe402bcee7d22dbf369e78"
server_key_iv: "f9056adb51530857b35ac23ae3014cd8"
server_key_version: "encryptionkey@0"
I20260808 02:39:00.354682 20123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:00.369685 20123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:00.370772 20123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:00.371145 20123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:00.393113 20123 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:45731
I20260808 02:39:00.393139 20189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:45731 every 8 connection(s)
I20260808 02:39:00.394807 20123 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:39:00.399118 20190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:39:00.402922 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20123
I20260808 02:39:00.403200 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:39:00.403978 10321 external_mini_cluster.cc:1428] Setting key 126b06af88d46a01e4cdf807951cb452
I20260808 02:39:00.412446 20190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f: Bootstrap starting.
I20260808 02:39:00.416774 20190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f: Neither blocks nor log segments found. Creating new log.
I20260808 02:39:00.418114 20190 log.cc:824] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:39:00.422315 20190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f: No bootstrap required, opened a new log
I20260808 02:39:00.422996 20193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:00.406453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39874 (local address 127.10.20.126:45731)
0808 02:39:00.408023 (+ 1570us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:00.408036 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:00.408100 (+ 64us) server_negotiation.cc:407] Connection header received
0808 02:39:00.410809 (+ 2709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:00.410844 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:00.411470 (+ 626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:00.411960 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:00.412807 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:00.415032 (+ 2225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:00.416985 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:00.417873 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:00.418248 (+ 375us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:00.419670 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:00.419679 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:00.419697 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:00.420582 (+ 885us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:00.420698 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:00.420729 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:00.420882 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:00.421142 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 02:39:00.421523 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":418,"threads_started":1}
I20260808 02:39:00.431063 20190 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ebd823727e4ab9a0517c534ca6835f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45731 } }
I20260808 02:39:00.431495 20190 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:39:00.431583 20190 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ebd823727e4ab9a0517c534ca6835f, State: Initialized, Role: FOLLOWER
I20260808 02:39:00.432142 20190 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ebd823727e4ab9a0517c534ca6835f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45731 } }
I20260808 02:39:00.432356 20190 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:39:00.432472 20190 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:39:00.432603 20190 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:39:00.435055 20190 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ebd823727e4ab9a0517c534ca6835f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45731 } }
I20260808 02:39:00.435640 20190 leader_election.cc:302] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8ebd823727e4ab9a0517c534ca6835f; no voters:
I20260808 02:39:00.436305 20190 leader_election.cc:288] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:39:00.436564 20195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:39:00.437860 20195 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [term 1 LEADER]: Becoming Leader. State: Replica: c8ebd823727e4ab9a0517c534ca6835f, State: Running, Role: LEADER
I20260808 02:39:00.438925 20190 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:39:00.438823 20195 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ebd823727e4ab9a0517c534ca6835f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45731 } }
I20260808 02:39:00.442217 20197 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8ebd823727e4ab9a0517c534ca6835f. Latest consensus state: current_term: 1 leader_uuid: "c8ebd823727e4ab9a0517c534ca6835f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ebd823727e4ab9a0517c534ca6835f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45731 } } }
I20260808 02:39:00.442723 20197 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [sys.catalog]: This master's current role is: LEADER
I20260808 02:39:00.443552 20196 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8ebd823727e4ab9a0517c534ca6835f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ebd823727e4ab9a0517c534ca6835f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45731 } } }
I20260808 02:39:00.443944 20196 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f [sys.catalog]: This master's current role is: LEADER
I20260808 02:39:00.450309 20204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:39:00.457293 20204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:39:00.468909 20204 catalog_manager.cc:1347] Generated new cluster ID: 0cbe995031dc446f8744ae9a598421b8
I20260808 02:39:00.469069 20204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:39:00.490173 20204 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:39:00.491756 20204 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:39:00.498236 20204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8ebd823727e4ab9a0517c534ca6835f: Generated new TSK 0
I20260808 02:39:00.499243 20204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:39:00.516295 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45731
--builtin_ntp_servers=127.10.20.84:45071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 02:39:00.927659 20215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:00.927994 20215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:00.928107 20215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:00.936990 20215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:00.937126 20215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:00.937249 20215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:39:00.948539 20215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:00.949925 20215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:00.952049 20215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:00.969029 20220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:00.969187 20223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:00.969857 20221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:00.970719 20215 server_base.cc:1034] running on GCE node
I20260808 02:39:00.971524 20215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:00.972906 20215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:00.974186 20215 hybrid_clock.cc:648] HybridClock initialized: now 1786156740974108 us; error 68 us; skew 500 ppm
I20260808 02:39:00.974556 20215 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:00.977487 20215 webserver.cc:460] Webserver started at http://127.10.20.65:42481/ using document root <none> and password file <none>
I20260808 02:39:00.978331 20215 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:00.978441 20215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:00.978854 20215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:00.982396 20215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "7d7c867f3e3b4e9eb8868aad50f9c17c"
format_stamp: "Formatted at 2026-08-08 02:39:00 on dist-test-slave-8tdl"
server_key: "80616eb12ed0e8359594ba696f482e45"
server_key_iv: "8627d2f9e2104b4c156c236c0ac12679"
server_key_version: "encryptionkey@0"
I20260808 02:39:00.983484 20215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "7d7c867f3e3b4e9eb8868aad50f9c17c"
format_stamp: "Formatted at 2026-08-08 02:39:00 on dist-test-slave-8tdl"
server_key: "80616eb12ed0e8359594ba696f482e45"
server_key_iv: "8627d2f9e2104b4c156c236c0ac12679"
server_key_version: "encryptionkey@0"
I20260808 02:39:00.990083 20215 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:39:00.994956 20229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:00.996692 20215 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:39:00.996891 20215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "7d7c867f3e3b4e9eb8868aad50f9c17c"
format_stamp: "Formatted at 2026-08-08 02:39:00 on dist-test-slave-8tdl"
server_key: "80616eb12ed0e8359594ba696f482e45"
server_key_iv: "8627d2f9e2104b4c156c236c0ac12679"
server_key_version: "encryptionkey@0"
I20260808 02:39:00.997181 20215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:01.015311 20215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:01.016335 20215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:01.016700 20215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:01.018138 20215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:01.020265 20215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:01.020421 20215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:01.020586 20215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:01.020680 20215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:01.059770 20215 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:37845
I20260808 02:39:01.059832 20343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:37845 every 8 connection(s)
I20260808 02:39:01.061409 20215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:39:01.069620 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20215
I20260808 02:39:01.069871 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:39:01.070595 10321 external_mini_cluster.cc:1428] Setting key aa4b449b04fac21fbfbe90434562046f
I20260808 02:39:01.074158 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45731
--builtin_ntp_servers=127.10.20.84:45071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 02:39:01.078028 20346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:01.064684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:57721 (local address 127.10.20.126:45731)
0808 02:39:01.065205 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:01.065210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:01.066485 (+ 1275us) server_negotiation.cc:407] Connection header received
0808 02:39:01.068610 (+ 2125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:01.068616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:01.068721 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:01.068849 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:01.070188 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.071317 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.074212 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.074823 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.074948 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:01.077099 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:01.077105 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:01.077109 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:01.077133 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:01.077181 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:01.077194 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:01.077282 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:01.077626 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 02:39:01.077744 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":275,"threads_started":1}
I20260808 02:39:01.080029 20347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:01.065307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45731 (local address 127.10.20.65:57721)
0808 02:39:01.066294 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:01.066342 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:01.068291 (+ 1949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:01.069141 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:01.069151 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:01.069252 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:01.069989 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:01.070016 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.071613 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.071620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:01.073942 (+ 2322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:01.073965 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.075125 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.075137 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:01.075550 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:01.076601 (+ 1051us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:39:01.076607 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:01.076679 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:39:01.076823 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:01.077317 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:01.077341 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:01.077355 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 02:39:01.077604 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 02:39:01.078236 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":325,"threads_started":1}
I20260808 02:39:01.082649 20344 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45731
I20260808 02:39:01.083150 20344 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:01.084192 20344 heartbeater.cc:511] Master 127.10.20.126:45731 requested a full tablet report, sending...
I20260808 02:39:01.087621 20154 ts_manager.cc:194] Registered new tserver with Master: 7d7c867f3e3b4e9eb8868aad50f9c17c (127.10.20.65:37845)
I20260808 02:39:01.090065 20154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.65:57721
W20260808 02:39:01.450026 20348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:01.450378 20348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:01.450762 20348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:01.460546 20348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:01.460700 20348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:01.460892 20348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:39:01.471442 20348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:01.472908 20348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:01.475030 20348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:01.490936 20356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:01.490914 20354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:01.490849 20353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:01.491865 20348 server_base.cc:1034] running on GCE node
I20260808 02:39:01.492637 20348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:01.494030 20348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:01.495260 20348 hybrid_clock.cc:648] HybridClock initialized: now 1786156741495233 us; error 94 us; skew 500 ppm
I20260808 02:39:01.495640 20348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:01.498626 20348 webserver.cc:460] Webserver started at http://127.10.20.66:46829/ using document root <none> and password file <none>
I20260808 02:39:01.499504 20348 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:01.499606 20348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:01.499900 20348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:01.503408 20348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "71c9046344254bfd8a515b011932659a"
format_stamp: "Formatted at 2026-08-08 02:39:01 on dist-test-slave-8tdl"
server_key: "79278f4d87eaf8a1be052f1b5542275a"
server_key_iv: "694fd659421100be9cf6c6a5507668ad"
server_key_version: "encryptionkey@0"
I20260808 02:39:01.504325 20348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "71c9046344254bfd8a515b011932659a"
format_stamp: "Formatted at 2026-08-08 02:39:01 on dist-test-slave-8tdl"
server_key: "79278f4d87eaf8a1be052f1b5542275a"
server_key_iv: "694fd659421100be9cf6c6a5507668ad"
server_key_version: "encryptionkey@0"
I20260808 02:39:01.510381 20348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:39:01.514556 20362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:01.516324 20348 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:39:01.516566 20348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "71c9046344254bfd8a515b011932659a"
format_stamp: "Formatted at 2026-08-08 02:39:01 on dist-test-slave-8tdl"
server_key: "79278f4d87eaf8a1be052f1b5542275a"
server_key_iv: "694fd659421100be9cf6c6a5507668ad"
server_key_version: "encryptionkey@0"
I20260808 02:39:01.516852 20348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:01.533303 20348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:01.534292 20348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:01.534633 20348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:01.535811 20348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:01.537431 20348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:01.537528 20348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:01.537668 20348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:01.537737 20348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:01.578239 20348 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:41865
I20260808 02:39:01.578302 20477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:41865 every 8 connection(s)
I20260808 02:39:01.579808 20348 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:39:01.584121 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20348
I20260808 02:39:01.584333 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:39:01.584923 10321 external_mini_cluster.cc:1428] Setting key 530da567adc0d28b942f05317f680d70
I20260808 02:39:01.588410 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45731
--builtin_ntp_servers=127.10.20.84:45071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 02:39:01.594872 20480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:01.582581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:33385 (local address 127.10.20.126:45731)
0808 02:39:01.583145 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:01.583150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:01.584552 (+ 1402us) server_negotiation.cc:407] Connection header received
0808 02:39:01.586811 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:01.586816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:01.586886 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:01.587011 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:01.588284 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.589418 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.591256 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.591989 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.592142 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:01.593779 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:01.593788 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:01.593796 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:01.593826 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:01.593879 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:01.593898 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:01.593997 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:01.594241 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 02:39:01.594366 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":285,"threads_started":1}
I20260808 02:39:01.596072 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:01.583116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45731 (local address 127.10.20.66:33385)
0808 02:39:01.584228 (+ 1112us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:01.584283 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:01.586400 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:01.587318 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:01.587331 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:01.587483 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:01.588091 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:01.588109 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.589601 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.589606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:01.591097 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:01.591112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:01.592260 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:01.592268 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:01.592533 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:01.593357 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:39:01.593360 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:01.593410 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:39:01.593541 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:01.594012 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:01.594024 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:01.594033 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 02:39:01.594211 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 02:39:01.594587 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":288,"threads_started":1}
I20260808 02:39:01.597929 20478 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45731
I20260808 02:39:01.598382 20478 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:01.599411 20478 heartbeater.cc:511] Master 127.10.20.126:45731 requested a full tablet report, sending...
I20260808 02:39:01.601472 20154 ts_manager.cc:194] Registered new tserver with Master: 71c9046344254bfd8a515b011932659a (127.10.20.66:41865)
I20260808 02:39:01.603096 20154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.66:33385
W20260808 02:39:01.972402 20482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:01.972760 20482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:01.972854 20482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:01.982216 20482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:01.982383 20482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:01.982512 20482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:39:01.993793 20482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:01.995354 20482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:01.997247 20482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:02.016120 20490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:02.016173 20487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:02.016291 20488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:02.022522 20482 server_base.cc:1034] running on GCE node
I20260808 02:39:02.023635 20482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:02.025149 20482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:02.026604 20482 hybrid_clock.cc:648] HybridClock initialized: now 1786156742026532 us; error 51 us; skew 500 ppm
I20260808 02:39:02.027122 20482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:02.030262 20482 webserver.cc:460] Webserver started at http://127.10.20.67:41653/ using document root <none> and password file <none>
I20260808 02:39:02.031222 20482 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:02.031329 20482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:02.031688 20482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:02.039341 20482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "562f3fc841164ab6a45096160d4a2ad7"
format_stamp: "Formatted at 2026-08-08 02:39:02 on dist-test-slave-8tdl"
server_key: "73a71e31865d98542f53fb52664253e6"
server_key_iv: "04611953e83fd392a12a647cc0f8282a"
server_key_version: "encryptionkey@0"
I20260808 02:39:02.040484 20482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "562f3fc841164ab6a45096160d4a2ad7"
format_stamp: "Formatted at 2026-08-08 02:39:02 on dist-test-slave-8tdl"
server_key: "73a71e31865d98542f53fb52664253e6"
server_key_iv: "04611953e83fd392a12a647cc0f8282a"
server_key_version: "encryptionkey@0"
I20260808 02:39:02.048477 20482 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.005s
I20260808 02:39:02.053246 20496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:02.055392 20482 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:39:02.055645 20482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "562f3fc841164ab6a45096160d4a2ad7"
format_stamp: "Formatted at 2026-08-08 02:39:02 on dist-test-slave-8tdl"
server_key: "73a71e31865d98542f53fb52664253e6"
server_key_iv: "04611953e83fd392a12a647cc0f8282a"
server_key_version: "encryptionkey@0"
I20260808 02:39:02.055927 20482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:02.077665 20482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:02.078790 20482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:02.079161 20482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:02.080320 20482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:02.082089 20482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:02.082197 20482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:02.082346 20482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:02.082453 20482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:02.095080 20344 heartbeater.cc:503] Master 127.10.20.126:45731 was elected leader, sending a full tablet report...
I20260808 02:39:02.124513 20482 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:33453
I20260808 02:39:02.124629 20612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:33453 every 8 connection(s)
I20260808 02:39:02.126075 20482 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:39:02.128659 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20482
I20260808 02:39:02.128924 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:39:02.129772 10321 external_mini_cluster.cc:1428] Setting key 598d341bac77b27e0579d1784c6879cc
I20260808 02:39:02.142431 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:02.129391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:56925 (local address 127.10.20.126:45731)
0808 02:39:02.129946 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:02.129954 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:02.131645 (+ 1691us) server_negotiation.cc:407] Connection header received
0808 02:39:02.133887 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:02.133892 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:02.133969 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:02.134076 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:02.135755 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.136601 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.138610 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.139262 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.139396 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:02.141267 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:02.141274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:02.141277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:02.141303 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:02.141352 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:02.141366 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:02.141458 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:02.141896 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 02:39:02.142010 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":274,"threads_started":1}
I20260808 02:39:02.144363 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:02.130227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45731 (local address 127.10.20.67:56925)
0808 02:39:02.131458 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:02.131510 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:02.133558 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:02.134457 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:02.134467 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:02.134600 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:02.135508 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:02.135529 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.136873 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.136877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:02.138387 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:02.138404 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.139648 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.139654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:02.139892 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:02.140824 (+ 932us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:39:02.140827 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:02.140877 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:39:02.140991 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:02.141529 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:02.141540 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:02.141548 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 02:39:02.141823 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 02:39:02.142637 (+ 814us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":409,"threads_started":1}
I20260808 02:39:02.146273 20613 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45731
I20260808 02:39:02.146777 20613 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:02.147710 20613 heartbeater.cc:511] Master 127.10.20.126:45731 requested a full tablet report, sending...
I20260808 02:39:02.149302 20154 ts_manager.cc:194] Registered new tserver with Master: 562f3fc841164ab6a45096160d4a2ad7 (127.10.20.67:33453)
I20260808 02:39:02.150189 20154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.67:56925
I20260808 02:39:02.159883 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 02:39:02.167348 20615 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:39:02.165339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39880 (local address 127.10.20.126:45731)
0808 02:39:02.165581 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:02.165588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:02.166039 (+ 451us) server_negotiation.cc:407] Connection header received
0808 02:39:02.166272 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:02.166277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:02.166367 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:02.166509 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:02.167141 (+ 632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39880: BlockingRecv error: recv got EOF from 127.0.0.1:39880 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:39:02.169081 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20215
I20260808 02:39:02.178097 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:02.170276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42742 (local address 127.10.20.65:37845)
0808 02:39:02.170940 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:02.170953 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:02.170987 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:39:02.171068 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:02.171075 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:02.171331 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:02.171526 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:02.171997 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.173036 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.174387 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.175129 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.175285 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:02.176552 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:02.176561 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:02.176575 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:02.177207 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:02.177261 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:02.177282 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:02.177441 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:02.177574 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 02:39:02.177724 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":281,"threads_started":1}
I20260808 02:39:02.179800 20339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:02.269435 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20215
I20260808 02:39:02.290072 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20348
I20260808 02:39:02.299471 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:02.291254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59910 (local address 127.10.20.66:41865)
0808 02:39:02.291901 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:02.291909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:02.291942 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:39:02.292008 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:02.292015 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:02.292259 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:02.292401 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:02.292833 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.293893 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.295623 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.296349 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.296474 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:02.297724 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:02.297733 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:02.297747 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:02.298444 (+ 697us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:02.298497 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:02.298520 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:02.298619 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:02.298930 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 02:39:02.299138 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":361,"threads_started":1}
I20260808 02:39:02.301064 20473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:02.391072 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20348
I20260808 02:39:02.410437 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20482
I20260808 02:39:02.420145 20628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:02.411490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.10.20.67:33453)
0808 02:39:02.412186 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:02.412216 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:02.412263 (+ 47us) server_negotiation.cc:407] Connection header received
0808 02:39:02.412328 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:02.412335 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:02.412575 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:02.412713 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:02.413233 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.414380 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.416151 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:02.416862 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:02.417071 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:02.418370 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:02.418380 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:02.418397 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:02.419212 (+ 815us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:02.419272 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:02.419296 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:02.419413 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:02.419653 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 02:39:02.419786 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":336,"threads_started":1}
I20260808 02:39:02.421643 20608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:02.510588 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20482
I20260808 02:39:02.531054 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20123
I20260808 02:39:02.532830 20185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:02.653647 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20123
2026-08-08T02:39:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2859 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T02:39:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:39:02Z Disabled control of system clock
I20260808 02:39:02.756772 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:33009
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:34389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:33009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 02:39:03.147972 20634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:03.148345 20634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:03.148445 20634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:03.157192 20634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:39:03.157371 20634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:03.157418 20634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:03.157478 20634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:39:03.157531 20634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:39:03.168390 20634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:33009
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:33009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:03.169850 20634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:03.172015 20634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:03.185854 20639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:03.185964 20640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:03.185927 20642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:03.186836 20634 server_base.cc:1034] running on GCE node
I20260808 02:39:03.187749 20634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:03.189498 20634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:03.190796 20634 hybrid_clock.cc:648] HybridClock initialized: now 1786156743190747 us; error 41 us; skew 500 ppm
I20260808 02:39:03.191180 20634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:03.199069 20634 webserver.cc:460] Webserver started at http://127.10.20.126:34269/ using document root <none> and password file <none>
I20260808 02:39:03.199928 20634 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:03.200064 20634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:03.200419 20634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:03.204185 20634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "c55211297864427e9f6c784944e22233"
format_stamp: "Formatted at 2026-08-08 02:39:03 on dist-test-slave-8tdl"
server_key: "0373a416c1f92b84743920f6fa53be3b"
server_key_iv: "713003925966bca584a62d73c4917349"
server_key_version: "encryptionkey@0"
I20260808 02:39:03.205195 20634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "c55211297864427e9f6c784944e22233"
format_stamp: "Formatted at 2026-08-08 02:39:03 on dist-test-slave-8tdl"
server_key: "0373a416c1f92b84743920f6fa53be3b"
server_key_iv: "713003925966bca584a62d73c4917349"
server_key_version: "encryptionkey@0"
I20260808 02:39:03.211788 20634 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:39:03.216197 20649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:03.218245 20634 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:39:03.218485 20634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "c55211297864427e9f6c784944e22233"
format_stamp: "Formatted at 2026-08-08 02:39:03 on dist-test-slave-8tdl"
server_key: "0373a416c1f92b84743920f6fa53be3b"
server_key_iv: "713003925966bca584a62d73c4917349"
server_key_version: "encryptionkey@0"
I20260808 02:39:03.218808 20634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:03.225795 20634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:03.226900 20634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:03.227276 20634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:03.249682 20634 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:33009
I20260808 02:39:03.249732 20703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:33009 every 8 connection(s)
I20260808 02:39:03.251439 20634 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:39:03.253593 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20634
I20260808 02:39:03.253826 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:39:03.254835 10321 external_mini_cluster.cc:1428] Setting key 29598e3cebd301ae5e130adcd0799411
I20260808 02:39:03.257153 20704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:39:03.265600 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:03.257796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45216 (local address 127.10.20.126:33009)
0808 02:39:03.259101 (+ 1305us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:03.259115 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:03.259168 (+ 53us) server_negotiation.cc:407] Connection header received
0808 02:39:03.260968 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:03.261002 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:03.261561 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:03.262000 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:03.263437 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:03.263445 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:03.263461 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:03.263481 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:03.263585 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:03.263606 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:03.263829 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:03.263948 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 02:39:03.264416 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":457,"threads_started":1}
I20260808 02:39:03.272220 20704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233: Bootstrap starting.
I20260808 02:39:03.276360 20704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233: Neither blocks nor log segments found. Creating new log.
I20260808 02:39:03.277621 20704 log.cc:824] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233: Log is configured to *not* fsync() on all Append() calls
I20260808 02:39:03.281718 20704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233: No bootstrap required, opened a new log
I20260808 02:39:03.291198 20704 raft_consensus.cc:348] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c55211297864427e9f6c784944e22233" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33009 } }
I20260808 02:39:03.291728 20704 raft_consensus.cc:374] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:39:03.291872 20704 raft_consensus.cc:729] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55211297864427e9f6c784944e22233, State: Initialized, Role: FOLLOWER
I20260808 02:39:03.292582 20704 consensus_queue.cc:260] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c55211297864427e9f6c784944e22233" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33009 } }
I20260808 02:39:03.292906 20704 raft_consensus.cc:388] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:39:03.293092 20704 raft_consensus.cc:482] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:39:03.293309 20704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:39:03.296491 20704 raft_consensus.cc:504] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c55211297864427e9f6c784944e22233" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33009 } }
I20260808 02:39:03.297209 20704 leader_election.cc:302] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c55211297864427e9f6c784944e22233; no voters:
I20260808 02:39:03.298239 20704 leader_election.cc:288] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:39:03.298604 20709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:39:03.299480 20709 raft_consensus.cc:686] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [term 1 LEADER]: Becoming Leader. State: Replica: c55211297864427e9f6c784944e22233, State: Running, Role: LEADER
I20260808 02:39:03.300179 20709 consensus_queue.cc:237] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c55211297864427e9f6c784944e22233" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33009 } }
I20260808 02:39:03.301059 20704 sys_catalog.cc:564] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:39:03.303586 20710 sys_catalog.cc:455] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c55211297864427e9f6c784944e22233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c55211297864427e9f6c784944e22233" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33009 } } }
I20260808 02:39:03.304142 20710 sys_catalog.cc:458] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:39:03.303694 20711 sys_catalog.cc:455] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c55211297864427e9f6c784944e22233. Latest consensus state: current_term: 1 leader_uuid: "c55211297864427e9f6c784944e22233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c55211297864427e9f6c784944e22233" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33009 } } }
I20260808 02:39:03.304564 20711 sys_catalog.cc:458] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233 [sys.catalog]: This master's current role is: LEADER
I20260808 02:39:03.312856 20717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:39:03.319610 20717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:39:03.331347 20717 catalog_manager.cc:1347] Generated new cluster ID: 56960f319a234b819aae332c71fc0c9c
I20260808 02:39:03.331502 20717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:39:03.397583 20717 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:39:03.398154 20717 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:39:03.409220 20717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c55211297864427e9f6c784944e22233: Generated new TSK 0
I20260808 02:39:03.410326 20717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:39:03.419663 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33009
--builtin_ntp_servers=127.10.20.84:34389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 02:39:03.822631 20728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:03.823067 20728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:03.823168 20728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:03.832290 20728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:03.832446 20728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:03.832576 20728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:39:03.843413 20728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:03.844897 20728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:03.847061 20728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:03.862481 20733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:03.862401 20736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:03.862353 20734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:03.864200 20728 server_base.cc:1034] running on GCE node
I20260808 02:39:03.865072 20728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:03.866285 20728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:03.867585 20728 hybrid_clock.cc:648] HybridClock initialized: now 1786156743867532 us; error 47 us; skew 500 ppm
I20260808 02:39:03.868125 20728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:03.871079 20728 webserver.cc:460] Webserver started at http://127.10.20.65:40235/ using document root <none> and password file <none>
I20260808 02:39:03.871909 20728 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:03.872077 20728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:03.872457 20728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:03.875856 20728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "244aed2a6acd4e848645df3c5842aae7"
format_stamp: "Formatted at 2026-08-08 02:39:03 on dist-test-slave-8tdl"
server_key: "c256c2a88b2b46a5304296f3ca2df908"
server_key_iv: "5ec084f227edf359bddd41e90072ee2a"
server_key_version: "encryptionkey@0"
I20260808 02:39:03.876838 20728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "244aed2a6acd4e848645df3c5842aae7"
format_stamp: "Formatted at 2026-08-08 02:39:03 on dist-test-slave-8tdl"
server_key: "c256c2a88b2b46a5304296f3ca2df908"
server_key_iv: "5ec084f227edf359bddd41e90072ee2a"
server_key_version: "encryptionkey@0"
I20260808 02:39:03.883139 20728 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:39:03.887794 20742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:03.889837 20728 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:39:03.890102 20728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "244aed2a6acd4e848645df3c5842aae7"
format_stamp: "Formatted at 2026-08-08 02:39:03 on dist-test-slave-8tdl"
server_key: "c256c2a88b2b46a5304296f3ca2df908"
server_key_iv: "5ec084f227edf359bddd41e90072ee2a"
server_key_version: "encryptionkey@0"
I20260808 02:39:03.890394 20728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:03.898208 20728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:03.899741 20728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:03.900189 20728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:03.901582 20728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:03.903748 20728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:03.903913 20728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:03.904079 20728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:03.904179 20728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:03.945040 20728 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:35257
I20260808 02:39:03.945159 20858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:35257 every 8 connection(s)
I20260808 02:39:03.946575 20728 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:39:03.947962 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20728
I20260808 02:39:03.948173 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:39:03.948815 10321 external_mini_cluster.cc:1428] Setting key e87ce882a1016c8f1a68bcd9e007d322
I20260808 02:39:03.952292 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33009
--builtin_ntp_servers=127.10.20.84:34389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 02:39:03.956944 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:03.949648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:37691 (local address 127.10.20.126:33009)
0808 02:39:03.950238 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:03.950245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:03.951956 (+ 1711us) server_negotiation.cc:407] Connection header received
0808 02:39:03.953873 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:03.953884 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:03.953972 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:03.954127 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:03.955866 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:03.955875 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:03.955883 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:03.955914 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:03.955993 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:03.956016 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:03.956183 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:03.956403 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 02:39:03.956490 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":287,"threads_started":1}
I20260808 02:39:03.957901 20862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:03.950433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:33009 (local address 127.10.20.65:37691)
0808 02:39:03.951746 (+ 1313us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:03.951805 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:03.953504 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:03.954397 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:03.954407 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:03.954555 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:03.955473 (+ 918us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:39:03.955476 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:03.955520 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:39:03.955623 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:03.956168 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:03.956179 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:03.956186 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 02:39:03.956447 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 02:39:03.956716 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":444,"threads_started":1}
I20260808 02:39:03.959710 20859 heartbeater.cc:347] Connected to a master server at 127.10.20.126:33009
I20260808 02:39:03.960144 20859 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:03.961021 20859 heartbeater.cc:511] Master 127.10.20.126:33009 requested a full tablet report, sending...
I20260808 02:39:03.963986 20667 ts_manager.cc:194] Registered new tserver with Master: 244aed2a6acd4e848645df3c5842aae7 (127.10.20.65:35257)
W20260808 02:39:04.337240 20863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:04.337572 20863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:04.337670 20863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:04.345415 20863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:04.345559 20863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:04.345685 20863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:39:04.355568 20863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:04.356971 20863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:04.358965 20863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:04.374137 20869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:04.374207 20868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:04.374185 20872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:04.375519 20863 server_base.cc:1034] running on GCE node
I20260808 02:39:04.376274 20863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:04.377588 20863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:04.378871 20863 hybrid_clock.cc:648] HybridClock initialized: now 1786156744378827 us; error 72 us; skew 500 ppm
I20260808 02:39:04.379267 20863 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:04.382164 20863 webserver.cc:460] Webserver started at http://127.10.20.66:43021/ using document root <none> and password file <none>
I20260808 02:39:04.383107 20863 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:04.383257 20863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:04.383627 20863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:04.387115 20863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "7dfc59f8d4b54c52a27640591288f764"
format_stamp: "Formatted at 2026-08-08 02:39:04 on dist-test-slave-8tdl"
server_key: "86802f2028c5734d05ad7f6cecbc4144"
server_key_iv: "2b2088dd2cc7b7ee71521e7353eb8c54"
server_key_version: "encryptionkey@0"
I20260808 02:39:04.388083 20863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "7dfc59f8d4b54c52a27640591288f764"
format_stamp: "Formatted at 2026-08-08 02:39:04 on dist-test-slave-8tdl"
server_key: "86802f2028c5734d05ad7f6cecbc4144"
server_key_iv: "2b2088dd2cc7b7ee71521e7353eb8c54"
server_key_version: "encryptionkey@0"
I20260808 02:39:04.394882 20863 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:39:04.399211 20878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:04.401108 20863 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:39:04.401322 20863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "7dfc59f8d4b54c52a27640591288f764"
format_stamp: "Formatted at 2026-08-08 02:39:04 on dist-test-slave-8tdl"
server_key: "86802f2028c5734d05ad7f6cecbc4144"
server_key_iv: "2b2088dd2cc7b7ee71521e7353eb8c54"
server_key_version: "encryptionkey@0"
I20260808 02:39:04.401610 20863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:04.409739 20863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:04.410849 20863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:04.411162 20863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:04.412284 20863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:04.414467 20863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:04.414599 20863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:04.414821 20863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:04.414901 20863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:04.455821 20863 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:41193
I20260808 02:39:04.455873 20995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:41193 every 8 connection(s)
I20260808 02:39:04.457532 20863 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:39:04.462517 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 20863
I20260808 02:39:04.462747 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:39:04.463321 10321 external_mini_cluster.cc:1428] Setting key acaa050a02ef59672f875546c6966b6e
I20260808 02:39:04.467224 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33009
--builtin_ntp_servers=127.10.20.84:34389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 02:39:04.468532 20998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:04.461081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:39437 (local address 127.10.20.126:33009)
0808 02:39:04.461672 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:04.461678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:04.463330 (+ 1652us) server_negotiation.cc:407] Connection header received
0808 02:39:04.465760 (+ 2430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:04.465765 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:04.465866 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:04.466017 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:04.467674 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:04.467679 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:04.467683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:04.467701 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:04.467750 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:04.467763 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:04.467914 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:04.468117 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 02:39:04.468196 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":307,"threads_started":1}
I20260808 02:39:04.469674 20999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:04.461801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:33009 (local address 127.10.20.66:39437)
0808 02:39:04.463088 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:04.463152 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:04.465336 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:04.466244 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:04.466254 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:04.466365 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:04.467212 (+ 847us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:39:04.467215 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:04.467262 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:39:04.467404 (+ 142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:04.467866 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:04.467877 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:04.467888 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 02:39:04.468215 (+ 327us) client_negotiation.cc:240] Negotiation successful
0808 02:39:04.468534 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":422,"threads_started":1}
I20260808 02:39:04.471694 20996 heartbeater.cc:347] Connected to a master server at 127.10.20.126:33009
I20260808 02:39:04.472128 20996 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:04.472873 20996 heartbeater.cc:511] Master 127.10.20.126:33009 requested a full tablet report, sending...
I20260808 02:39:04.474942 20667 ts_manager.cc:194] Registered new tserver with Master: 7dfc59f8d4b54c52a27640591288f764 (127.10.20.66:41193)
W20260808 02:39:04.866026 21000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:04.866379 21000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:04.866552 21000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:04.874644 21000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:04.874892 21000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:04.875111 21000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:39:04.884986 21000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:34389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:04.886801 21000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:04.889178 21000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:04.907428 21008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:04.907338 21006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:04.907371 21005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:04.908612 21000 server_base.cc:1034] running on GCE node
I20260808 02:39:04.909304 21000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:04.910422 21000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:04.911631 21000 hybrid_clock.cc:648] HybridClock initialized: now 1786156744911565 us; error 60 us; skew 500 ppm
I20260808 02:39:04.912087 21000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:39:04.915414 21000 webserver.cc:460] Webserver started at http://127.10.20.67:38687/ using document root <none> and password file <none>
I20260808 02:39:04.916291 21000 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:04.916432 21000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:04.916757 21000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:04.920598 21000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "61d5d43624c44783a92c36ed6f279169"
format_stamp: "Formatted at 2026-08-08 02:39:04 on dist-test-slave-8tdl"
server_key: "f13431ba15ea5a51ad97a053c20b2c04"
server_key_iv: "5f922d5b1df686990cb3b004b1aef6c0"
server_key_version: "encryptionkey@0"
I20260808 02:39:04.921672 21000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "61d5d43624c44783a92c36ed6f279169"
format_stamp: "Formatted at 2026-08-08 02:39:04 on dist-test-slave-8tdl"
server_key: "f13431ba15ea5a51ad97a053c20b2c04"
server_key_iv: "5f922d5b1df686990cb3b004b1aef6c0"
server_key_version: "encryptionkey@0"
I20260808 02:39:04.929363 21000 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260808 02:39:04.933885 21014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:04.936368 21000 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 02:39:04.936604 21000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "61d5d43624c44783a92c36ed6f279169"
format_stamp: "Formatted at 2026-08-08 02:39:04 on dist-test-slave-8tdl"
server_key: "f13431ba15ea5a51ad97a053c20b2c04"
server_key_iv: "5f922d5b1df686990cb3b004b1aef6c0"
server_key_version: "encryptionkey@0"
I20260808 02:39:04.936872 21000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:04.944123 21000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:04.945511 21000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:04.946040 21000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:04.947404 21000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:04.949496 21000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:04.949613 21000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:04.949805 21000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:04.949896 21000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:04.968230 20859 heartbeater.cc:503] Master 127.10.20.126:33009 was elected leader, sending a full tablet report...
I20260808 02:39:04.995481 21000 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:37629
I20260808 02:39:04.995594 21130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:37629 every 8 connection(s)
I20260808 02:39:04.997016 21000 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:39:04.998065 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 21000
I20260808 02:39:04.998276 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:39:04.998868 10321 external_mini_cluster.cc:1428] Setting key db1e1b903fc0707b87bd8a79e821062e
I20260808 02:39:05.008459 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:05.000417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:48825 (local address 127.10.20.126:33009)
0808 02:39:05.001124 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:05.001131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:05.002889 (+ 1758us) server_negotiation.cc:407] Connection header received
0808 02:39:05.004835 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:05.004842 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:05.004922 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:05.005077 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:05.007377 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:05.007390 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:05.007394 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:05.007419 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:05.007494 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:05.007511 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:05.007673 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:05.007935 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 02:39:05.008025 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":407,"threads_started":1}
I20260808 02:39:05.009637 21134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:05.001407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:33009 (local address 127.10.20.67:48825)
0808 02:39:05.002710 (+ 1303us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:05.002776 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:05.004454 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:05.005390 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:05.005401 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:05.005535 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:05.006544 (+ 1009us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:39:05.006548 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:05.006622 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:39:05.006962 (+ 340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:05.007645 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:05.007660 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:05.007669 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 02:39:05.008048 (+ 379us) client_negotiation.cc:240] Negotiation successful
0808 02:39:05.008452 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":386,"threads_started":1}
I20260808 02:39:05.012097 21131 heartbeater.cc:347] Connected to a master server at 127.10.20.126:33009
I20260808 02:39:05.012558 21131 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:05.013324 21131 heartbeater.cc:511] Master 127.10.20.126:33009 requested a full tablet report, sending...
I20260808 02:39:05.015628 20667 ts_manager.cc:194] Registered new tserver with Master: 61d5d43624c44783a92c36ed6f279169 (127.10.20.67:37629)
I20260808 02:39:05.017130 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 02:39:05.025255 21133 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:39:05.023216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46188 (local address 127.10.20.126:33009)
0808 02:39:05.023432 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:05.023437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:05.024152 (+ 715us) server_negotiation.cc:407] Connection header received
0808 02:39:05.024387 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:05.024393 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:05.024468 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:05.024604 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:05.025020 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46188: BlockingRecv error: recv got EOF from 127.0.0.1:46188 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:39:05.027954 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20728
I20260808 02:39:05.033361 21141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:05.029651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41130 (local address 127.10.20.65:35257)
0808 02:39:05.030462 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:05.030473 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:05.030512 (+ 39us) server_negotiation.cc:407] Connection header received
0808 02:39:05.030602 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:05.030611 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:05.031156 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:05.031342 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:05.032482 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:05.032489 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:05.032502 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:05.032516 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:05.032574 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:05.032593 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:05.032744 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:05.032830 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 02:39:05.032933 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":395,"threads_started":1}
I20260808 02:39:05.034924 20854 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:05.122143 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20728
I20260808 02:39:05.146034 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20863
I20260808 02:39:05.150955 21143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:05.147415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.10.20.66:41193)
0808 02:39:05.148233 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:05.148242 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:05.148275 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:39:05.148348 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:05.148355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:05.148628 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:05.148802 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:05.149972 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:05.149980 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:05.149993 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:05.150083 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:05.150138 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:05.150156 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:05.150288 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:05.150437 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 02:39:05.150535 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":434,"threads_started":1}
I20260808 02:39:05.152602 20991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:05.243105 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20863
I20260808 02:39:05.265882 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 21000
I20260808 02:39:05.270246 21145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:05.267073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45198 (local address 127.10.20.67:37629)
0808 02:39:05.267785 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:05.267793 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:05.267826 (+ 33us) server_negotiation.cc:407] Connection header received
0808 02:39:05.267889 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:05.267895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:05.268192 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:05.268330 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:05.269462 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:05.269468 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:05.269480 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:39:05.269492 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:05.269535 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:39:05.269550 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:05.269694 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:05.269750 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 02:39:05.269834 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":386,"threads_started":1}
I20260808 02:39:05.271752 21126 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:05.359473 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 21000
I20260808 02:39:05.381456 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 20634
I20260808 02:39:05.383103 20699 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:05.498862 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 20634
2026-08-08T02:39:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2845 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:39:05 dist-test-slave-8tdl krb5kdc[21150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:39:05 dist-test-slave-8tdl krb5kdc[21150](info): set up 2 sockets
Aug 08 02:39:05 dist-test-slave-8tdl krb5kdc[21150](info): commencing operation
krb5kdc: starting...
W20260808 02:39:06.711911 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.004s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:39:06 dist-test-slave-8tdl krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:39:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:39:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:39:07.071496 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:38759
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:38759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:39:07.448443 21164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:07.448833 21164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:07.448988 21164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:07.456988 21164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:39:07.457248 21164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:07.457357 21164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:07.457459 21164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:39:07.457549 21164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:39:07.468559 21164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:38759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:38759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:07.470320 21164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:07.471894 21164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:07.486330 21170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:07.486353 21172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:07.486389 21169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:07.487437 21164 server_base.cc:1034] running on GCE node
I20260808 02:39:07.488536 21164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:07.490267 21164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:07.491608 21164 hybrid_clock.cc:648] HybridClock initialized: now 1786156747491562 us; error 40 us; skew 500 ppm
I20260808 02:39:07.492053 21164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:39:07 dist-test-slave-8tdl krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156747, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:39:07.496027 21164 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:39:07.497833 21164 webserver.cc:460] Webserver started at http://127.10.20.126:35295/ using document root <none> and password file <none>
I20260808 02:39:07.498663 21164 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:07.498908 21164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:07.499261 21164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:07.502605 21164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "b1fd5d4dd588441581a67e0b3c8f08b8"
format_stamp: "Formatted at 2026-08-08 02:39:07 on dist-test-slave-8tdl"
server_key: "a3a4d7cb30a4448a16bdf7d5a245c312"
server_key_iv: "01933e9df3b2d19bf116c0c5032af289"
server_key_version: "encryptionkey@0"
I20260808 02:39:07.503566 21164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "b1fd5d4dd588441581a67e0b3c8f08b8"
format_stamp: "Formatted at 2026-08-08 02:39:07 on dist-test-slave-8tdl"
server_key: "a3a4d7cb30a4448a16bdf7d5a245c312"
server_key_iv: "01933e9df3b2d19bf116c0c5032af289"
server_key_version: "encryptionkey@0"
I20260808 02:39:07.509580 21164 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260808 02:39:07.513666 21179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:07.515398 21164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:39:07.515673 21164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "b1fd5d4dd588441581a67e0b3c8f08b8"
format_stamp: "Formatted at 2026-08-08 02:39:07 on dist-test-slave-8tdl"
server_key: "a3a4d7cb30a4448a16bdf7d5a245c312"
server_key_iv: "01933e9df3b2d19bf116c0c5032af289"
server_key_version: "encryptionkey@0"
I20260808 02:39:07.515918 21164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:07.530866 21164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:07.536024 21164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:07.536370 21164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:07.557420 21164 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:38759
I20260808 02:39:07.557426 21233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:38759 every 8 connection(s)
I20260808 02:39:07.559135 21164 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:39:07.563663 21234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:39:07.568440 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 21164
I20260808 02:39:07.568687 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:39:07.569597 10321 external_mini_cluster.cc:1428] Setting key 898efde11a8e6ea03c97ddff886fe938
I20260808 02:39:07.579720 21234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8: Bootstrap starting.
I20260808 02:39:07.584507 21234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8: Neither blocks nor log segments found. Creating new log.
I20260808 02:39:07.585963 21234 log.cc:824] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8: Log is configured to *not* fsync() on all Append() calls
I20260808 02:39:07.589582 21234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8: No bootstrap required, opened a new log
Aug 08 02:39:07 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:39:07.598651 21234 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38759 } }
I20260808 02:39:07.599298 21234 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:39:07.599447 21234 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1fd5d4dd588441581a67e0b3c8f08b8, State: Initialized, Role: FOLLOWER
I20260808 02:39:07.600194 21234 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38759 } }
I20260808 02:39:07.600477 21234 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:39:07.600587 21237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:07.572355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40758 (local address 127.10.20.126:38759)
0808 02:39:07.573424 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:07.573442 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:07.573546 (+ 104us) server_negotiation.cc:407] Connection header received
0808 02:39:07.577338 (+ 3792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:07.577386 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:07.578117 (+ 731us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:07.578705 (+ 588us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:07.580838 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:07.583149 (+ 2311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:07.585159 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:07.586138 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:07.586378 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:07.591029 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:07.591038 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:07.591055 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:07.591100 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:07.594955 (+ 3855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:07.595876 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:07.595889 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:07.595897 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:07.596125 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:07.596564 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:07.596578 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:07.596581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:07.597285 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:07.597916 (+ 631us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:07.598434 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 02:39:07.599214 (+ 780us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":499,"threads_started":1}
I20260808 02:39:07.600654 21234 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:39:07.600878 21234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:39:07.603667 21234 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38759 } }
I20260808 02:39:07.604429 21234 leader_election.cc:302] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1fd5d4dd588441581a67e0b3c8f08b8; no voters:
I20260808 02:39:07.605130 21234 leader_election.cc:288] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:39:07.605324 21239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:39:07.606050 21239 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [term 1 LEADER]: Becoming Leader. State: Replica: b1fd5d4dd588441581a67e0b3c8f08b8, State: Running, Role: LEADER
I20260808 02:39:07.606669 21239 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38759 } }
I20260808 02:39:07.607565 21234 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:39:07.610952 21242 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1fd5d4dd588441581a67e0b3c8f08b8. Latest consensus state: current_term: 1 leader_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38759 } } }
I20260808 02:39:07.611393 21242 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [sys.catalog]: This master's current role is: LEADER
I20260808 02:39:07.612566 21245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:39:07.612334 21240 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1fd5d4dd588441581a67e0b3c8f08b8" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 38759 } } }
I20260808 02:39:07.615121 21240 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8 [sys.catalog]: This master's current role is: LEADER
I20260808 02:39:07.620397 21245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:39:07.632405 21245 catalog_manager.cc:1347] Generated new cluster ID: 10ce7db4c6644913ac9206487aef9a8b
I20260808 02:39:07.632586 21245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:39:07.667107 21245 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:39:07.669000 21245 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:39:07.677047 21245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8: Generated new TSK 0
I20260808 02:39:07.678174 21245 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:39:07.780409 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38759
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:39:08.156481 21262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:08.156813 21262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:08.156987 21262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:08.165361 21262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:08.165556 21262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:08.165776 21262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:39:08.176477 21262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38759
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:08.178022 21262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:08.179582 21262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:08.195080 21267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:08.194978 21268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:08.195009 21270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:08.196593 21262 server_base.cc:1034] running on GCE node
I20260808 02:39:08.197621 21262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:08.198937 21262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:08.200196 21262 hybrid_clock.cc:648] HybridClock initialized: now 1786156748200127 us; error 56 us; skew 500 ppm
I20260808 02:39:08.200623 21262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:39:08 dist-test-slave-8tdl krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:39:08.210459 21262 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:39:08.212495 21262 webserver.cc:460] Webserver started at http://127.10.20.65:45319/ using document root <none> and password file <none>
I20260808 02:39:08.213384 21262 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:08.213541 21262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:08.213930 21262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:08.217540 21262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "62d6740c7f9e4fed9f0443294c9f7f45"
format_stamp: "Formatted at 2026-08-08 02:39:08 on dist-test-slave-8tdl"
server_key: "a24d1b19f8ef193a1cb6c3e3f6ed2c5a"
server_key_iv: "aaa07944685e40cb447caed75b7b5bd9"
server_key_version: "encryptionkey@0"
I20260808 02:39:08.218456 21262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "62d6740c7f9e4fed9f0443294c9f7f45"
format_stamp: "Formatted at 2026-08-08 02:39:08 on dist-test-slave-8tdl"
server_key: "a24d1b19f8ef193a1cb6c3e3f6ed2c5a"
server_key_iv: "aaa07944685e40cb447caed75b7b5bd9"
server_key_version: "encryptionkey@0"
I20260808 02:39:08.225193 21262 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:39:08.230023 21277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:08.232048 21262 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 02:39:08.232321 21262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "62d6740c7f9e4fed9f0443294c9f7f45"
format_stamp: "Formatted at 2026-08-08 02:39:08 on dist-test-slave-8tdl"
server_key: "a24d1b19f8ef193a1cb6c3e3f6ed2c5a"
server_key_iv: "aaa07944685e40cb447caed75b7b5bd9"
server_key_version: "encryptionkey@0"
I20260808 02:39:08.232597 21262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:08.250463 21262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:08.256028 21262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:08.256404 21262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:08.257637 21262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:08.259243 21262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:08.259359 21262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:08.259522 21262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:08.259613 21262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:08.298839 21262 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:38485
I20260808 02:39:08.298934 21395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:38485 every 8 connection(s)
I20260808 02:39:08.300266 21262 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:39:08.309063 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 21262
I20260808 02:39:08.309306 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:39:08.309993 10321 external_mini_cluster.cc:1428] Setting key 88673133d2c53310369ce9c9dcc70670
Aug 08 02:39:08 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:39:08.323994 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:08.303616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:33721 (local address 127.10.20.126:38759)
0808 02:39:08.304255 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:08.304260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:08.305274 (+ 1014us) server_negotiation.cc:407] Connection header received
0808 02:39:08.307452 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:08.307458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:08.307568 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:08.307698 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:08.309678 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.310490 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.312619 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.313050 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.313208 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:08.317230 (+ 4022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:08.317236 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:08.317239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:08.317278 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:08.320226 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:08.321167 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:08.321172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:08.321174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:08.321365 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:08.321888 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:08.321893 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:08.321897 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:08.322215 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:08.322396 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:08.323302 (+ 906us) server_negotiation.cc:299] Negotiation successful
0808 02:39:08.323591 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":375,"threads_started":1}
I20260808 02:39:08.325145 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:08.304156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:38759 (local address 127.10.20.65:33721)
0808 02:39:08.304992 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:08.305034 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:08.307076 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:08.307988 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:08.307997 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:08.308708 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:08.309471 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:08.309497 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.310709 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.310718 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:08.312443 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:08.312459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.313337 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.313345 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:08.313609 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:08.314376 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:39:08.314401 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:08.316926 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:08.320422 (+ 3496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:39:08.320434 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:39:08.320457 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:39:08.320993 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:39:08.321500 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:39:08.321505 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:39:08.321509 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:39:08.321748 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:39:08.322364 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:08.322374 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:08.322867 (+ 493us) client_negotiation.cc:769] Sending connection context
0808 02:39:08.323161 (+ 294us) client_negotiation.cc:240] Negotiation successful
0808 02:39:08.323766 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":308,"threads_started":1}
I20260808 02:39:08.327291 21396 heartbeater.cc:347] Connected to a master server at 127.10.20.126:38759
I20260808 02:39:08.327683 21396 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:08.328658 21396 heartbeater.cc:511] Master 127.10.20.126:38759 requested a full tablet report, sending...
I20260808 02:39:08.331241 21197 ts_manager.cc:194] Registered new tserver with Master: 62d6740c7f9e4fed9f0443294c9f7f45 (127.10.20.65:38485)
I20260808 02:39:08.332845 21197 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:33721
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:39:08.387092 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38759
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:39:08.772301 21403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:08.772636 21403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:08.772748 21403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:08.780722 21403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:08.780877 21403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:08.780998 21403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:39:08.791822 21403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38759
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:08.793345 21403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:08.794821 21403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:08.810527 21408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:08.810585 21409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:08.810560 21411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:08.812183 21403 server_base.cc:1034] running on GCE node
I20260808 02:39:08.813618 21403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:08.815086 21403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:08.816522 21403 hybrid_clock.cc:648] HybridClock initialized: now 1786156748816441 us; error 53 us; skew 500 ppm
I20260808 02:39:08.817148 21403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:39:08 dist-test-slave-8tdl krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:39:08.822628 21403 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:39:08.826380 21403 webserver.cc:460] Webserver started at http://127.10.20.66:41257/ using document root <none> and password file <none>
I20260808 02:39:08.827455 21403 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:08.827626 21403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:08.827997 21403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:08.832605 21403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "171dff57dfd04d01aaf5dda4318ee928"
format_stamp: "Formatted at 2026-08-08 02:39:08 on dist-test-slave-8tdl"
server_key: "c5e06cb8c5a7527ca8892a666493627f"
server_key_iv: "4a7c1dccac7bc6ce89ea2ae79488e747"
server_key_version: "encryptionkey@0"
I20260808 02:39:08.833557 21403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "171dff57dfd04d01aaf5dda4318ee928"
format_stamp: "Formatted at 2026-08-08 02:39:08 on dist-test-slave-8tdl"
server_key: "c5e06cb8c5a7527ca8892a666493627f"
server_key_iv: "4a7c1dccac7bc6ce89ea2ae79488e747"
server_key_version: "encryptionkey@0"
I20260808 02:39:08.840618 21403 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260808 02:39:08.845374 21418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:08.847514 21403 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:39:08.847770 21403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "171dff57dfd04d01aaf5dda4318ee928"
format_stamp: "Formatted at 2026-08-08 02:39:08 on dist-test-slave-8tdl"
server_key: "c5e06cb8c5a7527ca8892a666493627f"
server_key_iv: "4a7c1dccac7bc6ce89ea2ae79488e747"
server_key_version: "encryptionkey@0"
I20260808 02:39:08.848102 21403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:08.871569 21403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:08.878895 21403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:08.879303 21403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:08.880573 21403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:08.883060 21403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:08.883194 21403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:08.883510 21403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:08.883615 21403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:08.930594 21403 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:43285
I20260808 02:39:08.930649 21536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:43285 every 8 connection(s)
I20260808 02:39:08.932199 21403 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:39:08.936900 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 21403
I20260808 02:39:08.937176 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:39:08.937800 10321 external_mini_cluster.cc:1428] Setting key efca4692ef8d785682a3004c4eb94855
Aug 08 02:39:08 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:39:08.965559 21539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:08.935926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:33793 (local address 127.10.20.126:38759)
0808 02:39:08.936795 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:08.936802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:08.938596 (+ 1794us) server_negotiation.cc:407] Connection header received
0808 02:39:08.940963 (+ 2367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:08.940969 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:08.941129 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:08.941281 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:08.943324 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.944577 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.946988 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.948213 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.948479 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:08.955375 (+ 6896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:08.955382 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:08.955386 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:08.955436 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:08.960499 (+ 5063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:08.961762 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:08.961773 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:08.961779 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:08.962004 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:08.962748 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:08.962758 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:08.962764 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:08.963389 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:08.963601 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:08.964660 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0808 02:39:08.965029 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":445,"threads_started":1}
I20260808 02:39:08.966420 21540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:08.936688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:38759 (local address 127.10.20.66:33793)
0808 02:39:08.938111 (+ 1423us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:08.938404 (+ 293us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:08.940570 (+ 2166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:08.941597 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:08.941607 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:08.942295 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:08.943090 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:08.943112 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.944914 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.944920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:08.946546 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:08.946567 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:08.948878 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:08.948889 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:08.949236 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:08.950286 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:39:08.950367 (+ 81us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:08.954891 (+ 4524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:08.960804 (+ 5913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:39:08.960815 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:39:08.960833 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:39:08.961529 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:39:08.962227 (+ 698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:39:08.962231 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:39:08.962234 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:39:08.962511 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:39:08.963639 (+ 1128us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:08.963648 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:08.964098 (+ 450us) client_negotiation.cc:769] Sending connection context
0808 02:39:08.964467 (+ 369us) client_negotiation.cc:240] Negotiation successful
0808 02:39:08.964987 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":401,"threads_started":1}
I20260808 02:39:08.968511 21537 heartbeater.cc:347] Connected to a master server at 127.10.20.126:38759
I20260808 02:39:08.969012 21537 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:08.970114 21537 heartbeater.cc:511] Master 127.10.20.126:38759 requested a full tablet report, sending...
I20260808 02:39:08.973053 21197 ts_manager.cc:194] Registered new tserver with Master: 171dff57dfd04d01aaf5dda4318ee928 (127.10.20.66:43285)
I20260808 02:39:08.974341 21197 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:33793
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:39:09.033702 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38759
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:39:09.336659 21396 heartbeater.cc:503] Master 127.10.20.126:38759 was elected leader, sending a full tablet report...
W20260808 02:39:09.416586 21543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:39:09.416932 21543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:39:09.417047 21543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:39:09.425153 21543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:39:09.425305 21543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:39:09.425444 21543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:39:09.436477 21543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:38759
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:39:09.438102 21543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:39:09.439705 21543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:39:09.456362 21552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:09.456441 21549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:39:09.456868 21550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:39:09.457464 21543 server_base.cc:1034] running on GCE node
I20260808 02:39:09.458240 21543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:39:09.459544 21543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:39:09.461046 21543 hybrid_clock.cc:648] HybridClock initialized: now 1786156749460919 us; error 102 us; skew 500 ppm
I20260808 02:39:09.461454 21543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:39:09 dist-test-slave-8tdl krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156749, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:39:09.466164 21543 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:39:09.468276 21543 webserver.cc:460] Webserver started at http://127.10.20.67:42663/ using document root <none> and password file <none>
I20260808 02:39:09.469642 21543 fs_manager.cc:359] Metadata directory not provided
I20260808 02:39:09.469854 21543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:39:09.470299 21543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:39:09.473771 21543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "b0ce541ed3074679a7f5d0632d114fa7"
format_stamp: "Formatted at 2026-08-08 02:39:09 on dist-test-slave-8tdl"
server_key: "6dc8f0bc60ee329f2e5aa1dcb5b43eef"
server_key_iv: "d35dc2650ec512fe0b8b193e42c66726"
server_key_version: "encryptionkey@0"
I20260808 02:39:09.474766 21543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "b0ce541ed3074679a7f5d0632d114fa7"
format_stamp: "Formatted at 2026-08-08 02:39:09 on dist-test-slave-8tdl"
server_key: "6dc8f0bc60ee329f2e5aa1dcb5b43eef"
server_key_iv: "d35dc2650ec512fe0b8b193e42c66726"
server_key_version: "encryptionkey@0"
I20260808 02:39:09.481532 21543 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:39:09.486209 21559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:09.488582 21543 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:39:09.488873 21543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "b0ce541ed3074679a7f5d0632d114fa7"
format_stamp: "Formatted at 2026-08-08 02:39:09 on dist-test-slave-8tdl"
server_key: "6dc8f0bc60ee329f2e5aa1dcb5b43eef"
server_key_iv: "d35dc2650ec512fe0b8b193e42c66726"
server_key_version: "encryptionkey@0"
I20260808 02:39:09.489252 21543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:39:09.517351 21543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:39:09.522532 21543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:39:09.522917 21543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:39:09.524066 21543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:39:09.525802 21543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:39:09.525926 21543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:09.526086 21543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:39:09.526186 21543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:39:09.574934 21543 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:33151
I20260808 02:39:09.574946 21677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:33151 every 8 connection(s)
I20260808 02:39:09.576419 21543 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:39:09.583376 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 21543
I20260808 02:39:09.583573 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:39:09.584079 10321 external_mini_cluster.cc:1428] Setting key 47e2da964ac418b504708bf69f9e14c5
Aug 08 02:39:09 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156749, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:39:09.604971 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.579887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:45467 (local address 127.10.20.126:38759)
0808 02:39:09.580496 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.580503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.581535 (+ 1032us) server_negotiation.cc:407] Connection header received
0808 02:39:09.583872 (+ 2337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.583879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.583999 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.584131 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:09.586266 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.587207 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.589053 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.589474 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.589626 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.595215 (+ 5589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:09.595225 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:09.595231 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:09.595295 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:09.600180 (+ 4885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:09.601499 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:09.601506 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:09.601509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:09.601687 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:09.602297 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:09.602301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:09.602303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:09.602627 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:09.602865 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.604108 (+ 1243us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.604455 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":273,"threads_started":1}
I20260808 02:39:09.607616 21681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.580478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:38759 (local address 127.10.20.67:45467)
0808 02:39:09.581322 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.581368 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.583386 (+ 2018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.584437 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.584447 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.585189 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:39:09.586071 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.586094 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.587395 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.587399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.588855 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.588871 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.589755 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.589764 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.590035 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.591135 (+ 1100us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:39:09.591174 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:39:09.594776 (+ 3602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:39:09.600384 (+ 5608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:39:09.600397 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:39:09.600421 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:39:09.601330 (+ 909us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:39:09.601821 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:39:09.601827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:39:09.601830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:39:09.602081 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:39:09.602844 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:39:09.602855 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:39:09.603457 (+ 602us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.603885 (+ 428us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.604647 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":328,"threads_started":1}
I20260808 02:39:09.611585 21678 heartbeater.cc:347] Connected to a master server at 127.10.20.126:38759
I20260808 02:39:09.612165 21678 heartbeater.cc:464] Registering TS with master...
I20260808 02:39:09.613556 21678 heartbeater.cc:511] Master 127.10.20.126:38759 requested a full tablet report, sending...
I20260808 02:39:09.615876 21197 ts_manager.cc:194] Registered new tserver with Master: b0ce541ed3074679a7f5d0632d114fa7 (127.10.20.67:33151)
I20260808 02:39:09.617149 21197 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:45467
I20260808 02:39:09.627562 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:39:09.652415 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.633498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40774 (local address 127.10.20.126:38759)
0808 02:39:09.633712 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.633722 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.635005 (+ 1283us) server_negotiation.cc:407] Connection header received
0808 02:39:09.635243 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.635248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.635400 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.635520 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:09.637638 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.638847 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.640426 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.641101 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.641259 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.644605 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:09.644613 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:09.644618 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:09.644672 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:09.648278 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:09.649454 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:09.649461 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:09.649465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:09.649691 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:09.650261 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:09.650265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:09.650268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:09.650817 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:09.651118 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.651714 (+ 596us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.652033 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:39:09.658293 21197 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:39:09.666872 21197 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:39:09.706925 21692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.681661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58586 (local address 127.10.20.66:43285)
0808 02:39:09.697578 (+ 15917us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.697591 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.697625 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:39:09.697763 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.697774 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.698050 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.699198 (+ 1148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.699466 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.700806 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.703782 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.705432 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.705606 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.705856 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.706276 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.706494 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15672,"thread_start_us":16762,"threads_started":1}
I20260808 02:39:09.706975 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.681402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:43285 (local address 127.0.0.1:58586)
0808 02:39:09.697098 (+ 15696us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.697123 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.697257 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.698385 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.698394 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.698433 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.699202 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.699218 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.700998 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.701005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.703579 (+ 2574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.703594 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.705686 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.705694 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.705927 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.705992 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.706164 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.706417 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12910,"mutex_wait_us":65,"thread_start_us":12509,"threads_started":1}
I20260808 02:39:09.707306 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.682751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60276 (local address 127.10.20.65:38485)
0808 02:39:09.696078 (+ 13327us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.696094 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.696143 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:39:09.697301 (+ 1158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.697314 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.697721 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.697964 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.699248 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.701136 (+ 1888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.704161 (+ 3025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.705712 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.705884 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.706088 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.706747 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.706960 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13051,"thread_start_us":10491,"threads_started":1}
I20260808 02:39:09.708420 21697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.695748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.10.20.67:33151)
0808 02:39:09.699455 (+ 3707us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.699464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.699506 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:39:09.699626 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.699634 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.699997 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.700232 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.700956 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.702777 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.705052 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.706441 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.706592 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.706874 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.707785 (+ 911us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.707974 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3493,"thread_start_us":3121,"threads_started":1}
I20260808 02:39:09.708696 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.695517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:33151 (local address 127.0.0.1:60050)
0808 02:39:09.697795 (+ 2278us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.697814 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.697929 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.700267 (+ 2338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.700272 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.700306 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.700700 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.700716 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.702977 (+ 2261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.702984 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.704862 (+ 1878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.704876 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.707045 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.707055 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.707230 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.707303 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.707402 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.707552 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2149,"mutex_wait_us":27,"thread_start_us":2718,"threads_started":1}
I20260808 02:39:09.709306 21693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.682028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60276)
0808 02:39:09.695748 (+ 13720us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.695797 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.696348 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.698123 (+ 1775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.698133 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.698164 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.698734 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.698767 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.701293 (+ 2526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.701299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.703931 (+ 2632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.703953 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.706277 (+ 2324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.706286 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.706479 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.706511 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.707601 (+ 1090us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.707766 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13423,"mutex_wait_us":26,"thread_start_us":14835,"threads_started":1}
I20260808 02:39:09.712116 21468 tablet_service.cc:1467] Processing CreateTablet for tablet 8852f3f90de94e6cb3b49e895ecaa77e (DEFAULT_TABLE table=test-table [id=ed65653b08c04357ad3a17a84b777080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:39:09.712503 21608 tablet_service.cc:1467] Processing CreateTablet for tablet 8852f3f90de94e6cb3b49e895ecaa77e (DEFAULT_TABLE table=test-table [id=ed65653b08c04357ad3a17a84b777080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:39:09.713742 21608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8852f3f90de94e6cb3b49e895ecaa77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:39:09.713224 21328 tablet_service.cc:1467] Processing CreateTablet for tablet 8852f3f90de94e6cb3b49e895ecaa77e (DEFAULT_TABLE table=test-table [id=ed65653b08c04357ad3a17a84b777080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:39:09.713784 21468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8852f3f90de94e6cb3b49e895ecaa77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:39:09.714735 21328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8852f3f90de94e6cb3b49e895ecaa77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:39:09.729924 21698 tablet_bootstrap.cc:492] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Bootstrap starting.
I20260808 02:39:09.731535 21699 tablet_bootstrap.cc:492] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Bootstrap starting.
I20260808 02:39:09.734645 21698 tablet_bootstrap.cc:654] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Neither blocks nor log segments found. Creating new log.
I20260808 02:39:09.735672 21699 tablet_bootstrap.cc:654] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Neither blocks nor log segments found. Creating new log.
I20260808 02:39:09.736238 21698 log.cc:824] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:39:09.737066 21699 log.cc:824] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Log is configured to *not* fsync() on all Append() calls
I20260808 02:39:09.740322 21702 tablet_bootstrap.cc:492] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Bootstrap starting.
I20260808 02:39:09.741889 21698 tablet_bootstrap.cc:492] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: No bootstrap required, opened a new log
I20260808 02:39:09.742244 21698 ts_tablet_manager.cc:1397] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.004s
I20260808 02:39:09.744199 21702 tablet_bootstrap.cc:654] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Neither blocks nor log segments found. Creating new log.
I20260808 02:39:09.744799 21699 tablet_bootstrap.cc:492] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: No bootstrap required, opened a new log
I20260808 02:39:09.745126 21699 ts_tablet_manager.cc:1397] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260808 02:39:09.745453 21702 log.cc:824] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Log is configured to *not* fsync() on all Append() calls
I20260808 02:39:09.748590 21702 tablet_bootstrap.cc:492] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: No bootstrap required, opened a new log
I20260808 02:39:09.748926 21702 ts_tablet_manager.cc:1397] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260808 02:39:09.756134 21698 raft_consensus.cc:348] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.756384 21699 raft_consensus.cc:348] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.756726 21698 raft_consensus.cc:374] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:39:09.756800 21699 raft_consensus.cc:374] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:39:09.756831 21698 raft_consensus.cc:729] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0ce541ed3074679a7f5d0632d114fa7, State: Initialized, Role: FOLLOWER
I20260808 02:39:09.756917 21699 raft_consensus.cc:729] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171dff57dfd04d01aaf5dda4318ee928, State: Initialized, Role: FOLLOWER
I20260808 02:39:09.757201 21702 raft_consensus.cc:348] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.757623 21702 raft_consensus.cc:374] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:39:09.757752 21702 raft_consensus.cc:729] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62d6740c7f9e4fed9f0443294c9f7f45, State: Initialized, Role: FOLLOWER
I20260808 02:39:09.757647 21698 consensus_queue.cc:260] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.757612 21699 consensus_queue.cc:260] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.758366 21702 consensus_queue.cc:260] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.760371 21702 ts_tablet_manager.cc:1428] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260808 02:39:09.763597 21537 heartbeater.cc:503] Master 127.10.20.126:38759 was elected leader, sending a full tablet report...
I20260808 02:39:09.764703 21699 ts_tablet_manager.cc:1428] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Time spent starting tablet: real 0.019s user 0.013s sys 0.007s
I20260808 02:39:09.765318 21678 heartbeater.cc:503] Master 127.10.20.126:38759 was elected leader, sending a full tablet report...
I20260808 02:39:09.767849 21698 ts_tablet_manager.cc:1428] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Time spent starting tablet: real 0.025s user 0.012s sys 0.013s
I20260808 02:39:09.793813 21706 raft_consensus.cc:482] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:39:09.794188 21706 raft_consensus.cc:504] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.795946 21704 raft_consensus.cc:482] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:39:09.796397 21706 leader_election.cc:288] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171dff57dfd04d01aaf5dda4318ee928 (127.10.20.66:43285), b0ce541ed3074679a7f5d0632d114fa7 (127.10.20.67:33151)
I20260808 02:39:09.796258 21704 raft_consensus.cc:504] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.798730 21704 leader_election.cc:288] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171dff57dfd04d01aaf5dda4318ee928 (127.10.20.66:43285), 62d6740c7f9e4fed9f0443294c9f7f45 (127.10.20.65:38485)
W20260808 02:39:09.803694 21398 tablet.cc:2369] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:39:09.807916 21681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.798992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.10.20.67:41457)
0808 02:39:09.799308 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.799328 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.799435 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.800024 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.800029 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.800066 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.800310 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.800326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.801994 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.801999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.804206 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.804229 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.806998 (+ 2769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.807005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.807236 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.807299 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.807415 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.807578 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260808 02:39:09.808216 21692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.796876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:57473 (local address 127.10.20.66:43285)
0808 02:39:09.797076 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.797080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.797746 (+ 666us) server_negotiation.cc:407] Connection header received
0808 02:39:09.798029 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.798036 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.798127 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.798198 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.799154 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.800353 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.805436 (+ 5083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.806824 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.807002 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.807091 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.807734 (+ 643us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.807894 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:39:09.808753 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.799293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:41457 (local address 127.10.20.65:38485)
0808 02:39:09.799720 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.799725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.799742 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:39:09.799795 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.799800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.799863 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.799953 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.800577 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.801810 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.804418 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.805776 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.805958 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.806058 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.808295 (+ 2237us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.808456 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":288}
I20260808 02:39:09.809042 21697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.798130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:57709 (local address 127.10.20.67:33151)
0808 02:39:09.798326 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.798332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.800381 (+ 2049us) server_negotiation.cc:407] Connection header received
0808 02:39:09.800670 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.800677 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.800766 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.800827 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.801806 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.803089 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.805950 (+ 2861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.807378 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.807504 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.807584 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.808609 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.808763 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":44}
I20260808 02:39:09.809221 21707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.796844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:43285 (local address 127.10.20.65:57473)
0808 02:39:09.797609 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.797625 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.797820 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.798457 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.798467 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.798501 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.798938 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.798956 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.800514 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.800519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.805205 (+ 4686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.805228 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.807264 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.807271 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.807525 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.807565 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.808506 (+ 941us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.808746 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"mutex_wait_us":36,"thread_start_us":394,"threads_started":1}
I20260808 02:39:09.809962 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.800047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:43285 (local address 127.10.20.67:53471)
0808 02:39:09.801140 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.801155 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.801306 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.802020 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.802024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.802058 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.802586 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.802600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.804281 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.804286 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.806586 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.806604 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.809012 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.809018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.809239 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.809279 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.809372 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.809550 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":957,"mutex_wait_us":118,"thread_start_us":763,"threads_started":1}
I20260808 02:39:09.809792 21349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "b0ce541ed3074679a7f5d0632d114fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" is_pre_election: true
I20260808 02:39:09.810495 21708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.797915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:33151 (local address 127.10.20.65:57709)
0808 02:39:09.800279 (+ 2364us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:09.800301 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:39:09.800489 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:39:09.801107 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:39:09.801111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:39:09.801139 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:39:09.801587 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.801598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.803285 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.803291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.805764 (+ 2473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:39:09.805775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.807791 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.807797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:39:09.807979 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.808430 (+ 451us) client_negotiation.cc:769] Sending connection context
0808 02:39:09.809655 (+ 1225us) client_negotiation.cc:240] Negotiation successful
0808 02:39:09.809828 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2248,"mutex_wait_us":2,"thread_start_us":409,"threads_started":1}
I20260808 02:39:09.810251 21490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171dff57dfd04d01aaf5dda4318ee928" is_pre_election: true
I20260808 02:39:09.810367 21349 raft_consensus.cc:2454] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce541ed3074679a7f5d0632d114fa7 in term 0.
I20260808 02:39:09.810801 21709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.798922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:53471 (local address 127.10.20.66:43285)
0808 02:39:09.799651 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.799656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.801251 (+ 1595us) server_negotiation.cc:407] Connection header received
0808 02:39:09.801513 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.801521 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.801616 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.801712 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:39:09.802864 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.804073 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.806875 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.808574 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.808769 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.808845 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.810216 (+ 1371us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.810391 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":774,"threads_started":1}
I20260808 02:39:09.810953 21490 raft_consensus.cc:2454] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62d6740c7f9e4fed9f0443294c9f7f45 in term 0.
I20260808 02:39:09.811554 21490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "b0ce541ed3074679a7f5d0632d114fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171dff57dfd04d01aaf5dda4318ee928" is_pre_election: true
I20260808 02:39:09.811784 21490 raft_consensus.cc:2454] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0ce541ed3074679a7f5d0632d114fa7 in term 0.
I20260808 02:39:09.811731 21563 leader_election.cc:302] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62d6740c7f9e4fed9f0443294c9f7f45, b0ce541ed3074679a7f5d0632d114fa7; no voters:
I20260808 02:39:09.811709 21281 leader_election.cc:302] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171dff57dfd04d01aaf5dda4318ee928, 62d6740c7f9e4fed9f0443294c9f7f45; no voters:
I20260808 02:39:09.812180 21706 raft_consensus.cc:2781] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:39:09.812005 21629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0ce541ed3074679a7f5d0632d114fa7" is_pre_election: true
I20260808 02:39:09.812364 21706 raft_consensus.cc:482] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:39:09.812479 21706 raft_consensus.cc:3037] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:39:09.812489 21629 raft_consensus.cc:2454] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62d6740c7f9e4fed9f0443294c9f7f45 in term 0.
I20260808 02:39:09.813572 21704 raft_consensus.cc:2781] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:39:09.813742 21704 raft_consensus.cc:482] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:39:09.813871 21704 raft_consensus.cc:3037] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:39:09.815533 21706 raft_consensus.cc:504] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.816226 21706 leader_election.cc:288] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [CANDIDATE]: Term 1 election: Requested vote from peers 171dff57dfd04d01aaf5dda4318ee928 (127.10.20.66:43285), b0ce541ed3074679a7f5d0632d114fa7 (127.10.20.67:33151)
I20260808 02:39:09.816421 21704 raft_consensus.cc:504] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.816879 21490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171dff57dfd04d01aaf5dda4318ee928"
I20260808 02:39:09.816888 21629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0ce541ed3074679a7f5d0632d114fa7"
I20260808 02:39:09.817118 21490 raft_consensus.cc:3037] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:39:09.817225 21704 leader_election.cc:288] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [CANDIDATE]: Term 1 election: Requested vote from peers 171dff57dfd04d01aaf5dda4318ee928 (127.10.20.66:43285), 62d6740c7f9e4fed9f0443294c9f7f45 (127.10.20.65:38485)
I20260808 02:39:09.817231 21629 raft_consensus.cc:2379] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62d6740c7f9e4fed9f0443294c9f7f45 in current term 1: Already voted for candidate b0ce541ed3074679a7f5d0632d114fa7 in this term.
I20260808 02:39:09.817803 21349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "b0ce541ed3074679a7f5d0632d114fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62d6740c7f9e4fed9f0443294c9f7f45"
I20260808 02:39:09.817817 21489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8852f3f90de94e6cb3b49e895ecaa77e" candidate_uuid: "b0ce541ed3074679a7f5d0632d114fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171dff57dfd04d01aaf5dda4318ee928"
I20260808 02:39:09.818114 21349 raft_consensus.cc:2379] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0ce541ed3074679a7f5d0632d114fa7 in current term 1: Already voted for candidate 62d6740c7f9e4fed9f0443294c9f7f45 in this term.
I20260808 02:39:09.818943 21563 leader_election.cc:302] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0ce541ed3074679a7f5d0632d114fa7; no voters: 171dff57dfd04d01aaf5dda4318ee928, 62d6740c7f9e4fed9f0443294c9f7f45
I20260808 02:39:09.819264 21704 raft_consensus.cc:2726] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 02:39:09.820377 21490 raft_consensus.cc:2454] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62d6740c7f9e4fed9f0443294c9f7f45 in term 1.
I20260808 02:39:09.820842 21281 leader_election.cc:302] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171dff57dfd04d01aaf5dda4318ee928, 62d6740c7f9e4fed9f0443294c9f7f45; no voters: b0ce541ed3074679a7f5d0632d114fa7
I20260808 02:39:09.821157 21706 raft_consensus.cc:2781] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:39:09.821650 21706 raft_consensus.cc:686] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 1 LEADER]: Becoming Leader. State: Replica: 62d6740c7f9e4fed9f0443294c9f7f45, State: Running, Role: LEADER
I20260808 02:39:09.822134 21706 consensus_queue.cc:237] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } }
I20260808 02:39:09.827577 21197 catalog_manager.cc:5495] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62d6740c7f9e4fed9f0443294c9f7f45 (127.10.20.65). New cstate: current_term: 1 leader_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62d6740c7f9e4fed9f0443294c9f7f45" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38485 } health_report { overall_health: HEALTHY } } }
W20260808 02:39:09.828539 21679 tablet.cc:2369] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:39:09.861114 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.854570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60280 (local address 127.10.20.65:38485)
0808 02:39:09.854852 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.854859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.854996 (+ 137us) server_negotiation.cc:407] Connection header received
0808 02:39:09.855174 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.855178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.855263 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.855407 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:39:09.855842 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.856730 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.858235 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.858670 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.858971 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.859646 (+ 675us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:39:09.860236 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:39:09.860356 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.860572 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.860659 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260808 02:39:09.870995 21490 raft_consensus.cc:1261] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 1 FOLLOWER]: Refusing update from remote peer 62d6740c7f9e4fed9f0443294c9f7f45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:39:09.871014 21629 raft_consensus.cc:1261] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 1 FOLLOWER]: Refusing update from remote peer 62d6740c7f9e4fed9f0443294c9f7f45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:39:09.871971 21706 consensus_queue.cc:1035] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171dff57dfd04d01aaf5dda4318ee928" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:39:09.872437 21711 consensus_queue.cc:1035] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0ce541ed3074679a7f5d0632d114fa7" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:39:09.905696 21196 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:39:09.906121 21196 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:39:09.910948 21196 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1fd5d4dd588441581a67e0b3c8f08b8: Sending DeleteTablet for 3 replicas of tablet 8852f3f90de94e6cb3b49e895ecaa77e
I20260808 02:39:09.912534 21468 tablet_service.cc:1514] Processing DeleteTablet for tablet 8852f3f90de94e6cb3b49e895ecaa77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:39:09 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:58586
I20260808 02:39:09.912729 21328 tablet_service.cc:1514] Processing DeleteTablet for tablet 8852f3f90de94e6cb3b49e895ecaa77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:39:09 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:60276
I20260808 02:39:09.912914 21608 tablet_service.cc:1514] Processing DeleteTablet for tablet 8852f3f90de94e6cb3b49e895ecaa77e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:39:09 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:60050
I20260808 02:39:09.916973 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 21262
I20260808 02:39:09.925697 21726 tablet_replica.cc:330] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: stopping tablet replica
I20260808 02:39:09.926522 21726 raft_consensus.cc:2229] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:39:09.927304 21726 raft_consensus.cc:2258] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:39:09.930084 21726 ts_tablet_manager.cc:1905] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:39:09.938432 21726 ts_tablet_manager.cc:1918] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:39:09.938781 21726 log.cc:1196] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/8852f3f90de94e6cb3b49e895ecaa77e
I20260808 02:39:09.939428 21726 ts_tablet_manager.cc:1939] T 8852f3f90de94e6cb3b49e895ecaa77e P b0ce541ed3074679a7f5d0632d114fa7: Deleting consensus metadata
I20260808 02:39:09.941635 21182 catalog_manager.cc:4841] TS b0ce541ed3074679a7f5d0632d114fa7 (127.10.20.67:33151): tablet 8852f3f90de94e6cb3b49e895ecaa77e (table test-table [id=ed65653b08c04357ad3a17a84b777080]) successfully deleted
I20260808 02:39:09.957476 21724 tablet_replica.cc:330] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: stopping tablet replica
I20260808 02:39:09.958159 21724 raft_consensus.cc:2229] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:39:09.959380 21725 tablet_replica.cc:330] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: stopping tablet replica
I20260808 02:39:09.959532 21724 raft_consensus.cc:2258] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:39:09.962175 21724 ts_tablet_manager.cc:1905] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 02:39:09 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:39:09.970883 21725 raft_consensus.cc:2229] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:39:09.971745 21725 raft_consensus.cc:2258] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:39:09.972477 21724 ts_tablet_manager.cc:1918] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:39:09.972697 21724 log.cc:1196] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/8852f3f90de94e6cb3b49e895ecaa77e
I20260808 02:39:09.973332 21724 ts_tablet_manager.cc:1939] T 8852f3f90de94e6cb3b49e895ecaa77e P 171dff57dfd04d01aaf5dda4318ee928: Deleting consensus metadata
I20260808 02:39:09.974596 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:09.920968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.10.20.65:38485)
0808 02:39:09.921605 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:09.921614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:09.940926 (+ 19312us) server_negotiation.cc:407] Connection header received
0808 02:39:09.942389 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:09.942399 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:09.942536 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:09.942632 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:09.945553 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.947360 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.952751 (+ 5391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:09.953890 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:09.954077 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:09.965037 (+ 10960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:09.965061 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:09.965083 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:09.965145 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:09.970048 (+ 4903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:09.971423 (+ 1375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:09.971436 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:09.971440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:09.971648 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:09.972239 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:09.972248 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:09.972254 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:09.972872 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:09.973230 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:09.973943 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 02:39:09.974233 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447}
I20260808 02:39:09.975273 21725 ts_tablet_manager.cc:1905] T 8852f3f90de94e6cb3b49e895ecaa77e P 62d6740c7f9e4fed9f0443294c9f7f45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:39:09.975651 21182 catalog_manager.cc:4841] TS 171dff57dfd04d01aaf5dda4318ee928 (127.10.20.66:43285): tablet 8852f3f90de94e6cb3b49e895ecaa77e (table test-table [id=ed65653b08c04357ad3a17a84b777080]) successfully deleted
I20260808 02:39:09.976217 21391 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:10.091485 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 21262
I20260808 02:39:10.113190 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 21403
W20260808 02:39:10.113137 21183 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:38485 (error 108)
I20260808 02:39:10.115227 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.114738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60288)
0808 02:39:10.114906 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.115041 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 02:39:10.115500 21183 catalog_manager.cc:4584] TS 62d6740c7f9e4fed9f0443294c9f7f45 (127.10.20.65:38485): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8852f3f90de94e6cb3b49e895ecaa77e: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Aug 08 02:39:10 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:39:10.132623 21709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.114126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.10.20.66:43285)
0808 02:39:10.114313 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:10.114317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:10.114447 (+ 130us) server_negotiation.cc:407] Connection header received
0808 02:39:10.115123 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:10.115127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:10.115212 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:10.115308 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:10.117090 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:10.117821 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:10.119251 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:10.119806 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:10.119934 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:10.124989 (+ 5055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:10.125011 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:10.125028 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:10.125083 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:10.129032 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:10.130137 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:10.130146 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:10.130148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:10.130311 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:10.130933 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:10.130938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:10.130940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:10.131456 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:10.131737 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:10.132143 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 02:39:10.132362 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:39:10.133522 21532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:10.169677 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.169082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60290)
0808 02:39:10.169362 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.169493 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260808 02:39:10.170955 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.170515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60302)
0808 02:39:10.170722 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.170821 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 02:39:10.232254 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.231569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60306)
0808 02:39:10.231898 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.232031 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260808 02:39:10.233469 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 21403
I20260808 02:39:10.233789 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.233209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60316)
0808 02:39:10.233489 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.233602 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 02:39:10.255537 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 21543
Aug 08 02:39:10 dist-test-slave-8tdl krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:39:10.274281 21697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.256577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60062 (local address 127.10.20.67:33151)
0808 02:39:10.256770 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 02:39:10.256775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:39:10.256797 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:39:10.257071 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:39:10.257076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:39:10.257151 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:39:10.257254 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:39:10.258670 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:10.259590 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:10.261318 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:39:10.261775 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:39:10.261887 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:39:10.267105 (+ 5218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:39:10.267125 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:39:10.267142 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:39:10.267201 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:39:10.270317 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:10.271632 (+ 1315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:10.271640 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:10.271643 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:10.271813 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:39:10.272418 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:39:10.272422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:39:10.272425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:39:10.272922 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:39:10.273234 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 02:39:10.273778 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 02:39:10.273984 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:39:10.275163 21673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:10.314541 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.314005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60328)
0808 02:39:10.314251 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.314358 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260808 02:39:10.315716 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:39:10.315307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38485 (local address 127.0.0.1:60332)
0808 02:39:10.315520 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 02:39:10.315596 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 02:39:10.374243 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 21543
I20260808 02:39:10.394423 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 21164
I20260808 02:39:10.395990 21228 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:39:10.515884 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 21164
2026-08-08T02:39:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5018 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:39:10 dist-test-slave-8tdl krb5kdc[21735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:39:10 dist-test-slave-8tdl krb5kdc[21735](info): set up 2 sockets
Aug 08 02:39:10 dist-test-slave-8tdl krb5kdc[21735](info): commencing operation
krb5kdc: starting...
W20260808 02:39:11.815905 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:39:12 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:39:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:39:12Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/rangeradmin_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/rangeradmin_127.10.20.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/rangerlookup_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/rangerlookup_127.10.20.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
I20260808 02:39:12.334447 10321 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksj7NWU/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/postgres -l logfile start
2026-08-08 02:39:15.778 UTC [21766] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 02:39:15.779 UTC [21766] LOG: listening on IPv4 address "127.10.20.84", port 56995
2026-08-08 02:39:15.784 UTC [21766] LOG: listening on Unix socket "/tmp/.s.PGSQL.56995"
2026-08-08 02:39:15.814 UTC [21768] LOG: database system was shut down at 2026-08-08 02:39:13 UTC
2026-08-08 02:39:15.818 UTC [21766] LOG: database system is ready to accept connections
I20260808 02:39:16.867103 10321 mini_postgres.cc:96] Postgres bound to 56995
2026-08-08 02:39:16.896 UTC [21777] FATAL: database "slave" does not exist
127.10.20.84:56995 - accepting connections
I20260808 02:39:16.897624 10321 mini_ranger.cc:161] Starting Ranger...
I20260808 02:39:16.937796 10321 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 02:39:17.689282 10321 mini_ranger.cc:87] Created ranger Postgres database
I20260808 02:39:17.689514 10321 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-admin
2026-08-08 02:39:18,075 [I] DB FLAVOR :POSTGRES
2026-08-08 02:39:18,076 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:39:18,076 [I] Checking connection..
2026-08-08 02:39:18,076 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 02:39:18,351 [I] Checking connection passed.
2026-08-08 02:39:18,351 [I] --------- Verifying version history table ---------
2026-08-08 02:39:18,352 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:39:18,650 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:39:18,650 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:39:18,952 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:39:18,952 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 02:39:18,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 02:39:19.236 UTC [21846] WARNING: there is no transaction in progress
2026-08-08 02:39:19,245 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 02:39:19,245 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:39:19,556 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 02:39:19,557 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:39:19,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 02:39:19,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 02:39:20,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8tdl.c.gcp-upstream.internal','N') ;"
2026-08-08 02:39:20,446 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:39:20,745 [I] Table x_portal_user does not exist in database ranger
2026-08-08 02:39:20,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:39:21,023 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 02:39:21,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:39:21,303 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:39:21,575 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 02:39:21,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 02:39:22.908 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:22.932 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:22.957 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:22.977 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.003 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.030 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.109 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.120 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.141 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.156 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.171 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.191 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.203 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.212 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.224 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:23.234 UTC [21959] WARNING: there is no transaction in progress
2026-08-08 02:39:24,210 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 02:39:24,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 02:39:24,502 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 02:39:24,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:39:24,777 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 02:39:24,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:39:25,073 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 02:39:25,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:39:25,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:39:25,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8tdl.c.gcp-upstream.internal';"
2026-08-08 02:39:25,962 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 02:39:25,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 02:39:26,232 [I] DB_PATCHES have already been applied
I20260808 02:39:26.239215 10321 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksj7NWU/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 02:39:26.239357 10321 mini_ranger.cc:193] Using host: 127.10.20.84
I20260808 02:39:26.267091 10321 mini_ranger.cc:227] Ranger admin URL: http://127.10.20.84:44999
Aug 08, 2026 2:39:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:39:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:39:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:39:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:39:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:39:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:39:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 02:39:27.506990 10321 mini_ranger.cc:160] Time spent starting Ranger: real 10.609s user 0.002s sys 0.089s
Aug 08, 2026 2:39:50 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:39:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 2:39:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:39:50 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:39:51 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 02:39:52.645102 10321 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/rangerkms_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/rangerkms_127.10.20.84@KRBTEST.COM.keytab.
W20260808 02:39:52.755765 10321 mini_kdc.cc:262] Time spent creating service keytab for rangerkms/127.10.20.84@KRBTEST.COM: real 0.109s user 0.004s sys 0.034s
WARNING: no policy specified for HTTP/127.10.20.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.20.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
W20260808 02:39:52.856688 10321 mini_kdc.cc:262] Time spent creating service keytab for HTTP/127.10.20.84@KRBTEST.COM: real 0.101s user 0.003s sys 0.030s
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 02:39:52 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156792, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 02:39:52.970592 10321 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 02:39:53.009258 10321 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 02:39:54.584359 10321 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 02:39:54.584522 10321 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms
I20260808 02:39:54.584712 10321 mini_ranger_kms.cc:227] Using postgres at 127.10.20.84:56995
2026-08-08 02:39:55,230 [I] DB FLAVOR :POSTGRES
2026-08-08 02:39:55,231 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:39:55,231 [I] Checking connection
2026-08-08 02:39:55,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 02:39:55,510 [I] connection success
2026-08-08 02:39:55,511 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 02:39:55,511 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 02:39:55,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 02:39:55,796 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 02:39:55,796 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:39:55,796 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 02:39:55,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:56995/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 02:39:56,106 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 02:39:56.720829 10321 mini_ranger_kms.cc:310] Created kms service
I20260808 02:39:56.986066 10321 mini_ranger_kms.cc:326] Created kudu user
I20260808 02:39:57.043342 10321 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 02:39:57 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156792, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:39:57.522990 10321 mini_ranger_kms.cc:384] Added ranger policy
I20260808 02:39:57.524710 10321 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 02:39:57.524825 10321 mini_ranger_kms.cc:240] Using host: 127.10.20.84
I20260808 02:39:57.571664 10321 mini_ranger_kms.cc:276] Ranger KMS PID: 22149
I20260808 02:39:57.571900 10321 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.20.84:45345
Aug 08, 2026 2:39:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:39:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:39:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:39:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:39:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:39:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 02:40:00.260562 10321 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.290s user 0.169s sys 0.546s
I20260808 02:40:00.260954 10321 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 02:40:00.261216 10321 mini_ranger_kms.cc:401] 127.10.20.84:45345/kms/v1/keys
Aug 08 02:40:00 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156800, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.20.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 02:40:00 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156800, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.20.84@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
Aug 08 02:40:01 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156800, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.20.84@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
Aug 08 02:40:04 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
W20260808 02:40:04.372849 10321 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.20.126: real 0.101s user 0.000s sys 0.039s
I20260808 02:40:04.374884 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42009
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:38637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:42009
--ranger_config_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:45345/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:40:04.876514 22203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:40:04.876909 22203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:40:04.877092 22203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:40:04.885279 22203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:40:04.885447 22203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:40:04.885555 22203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:40:04.885797 22203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:40:04.885890 22203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:40:04.897838 22203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:38637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.20.84:45345/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:42009
--ranger_config_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:40:04.899405 22203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:40:04.900938 22203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:40:04.918452 22208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:04.918552 22209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:04.918478 22211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:40:04.919828 22203 server_base.cc:1034] running on GCE node
I20260808 02:40:04.920867 22203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:40:04.922848 22203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:40:04.926370 22203 hybrid_clock.cc:648] HybridClock initialized: now 1786156804926240 us; error 103 us; skew 500 ppm
I20260808 02:40:04.927385 22203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:40:04 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:40:04.938145 22203 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:40:04.940618 22203 webserver.cc:460] Webserver started at http://127.10.20.126:39735/ using document root <none> and password file <none>
I20260808 02:40:04.941416 22203 fs_manager.cc:359] Metadata directory not provided
I20260808 02:40:04.941534 22203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:40:04.941838 22203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:40:04 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:40:05.025023 22203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "324e30061ce84ae3b11004a985ec3564"
format_stamp: "Formatted at 2026-08-08 02:40:05 on dist-test-slave-8tdl"
server_key: "89430da7fc8cb9e9f4b3f971ace6af28"
server_key_iv: "eb3bd6c32d594610f44490040bb48122"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:05.026355 22203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "324e30061ce84ae3b11004a985ec3564"
format_stamp: "Formatted at 2026-08-08 02:40:05 on dist-test-slave-8tdl"
server_key: "89430da7fc8cb9e9f4b3f971ace6af28"
server_key_iv: "eb3bd6c32d594610f44490040bb48122"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:05.035152 22203 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260808 02:40:05.056944 22218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:05.059039 22203 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:40:05.059307 22203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "324e30061ce84ae3b11004a985ec3564"
format_stamp: "Formatted at 2026-08-08 02:40:05 on dist-test-slave-8tdl"
server_key: "89430da7fc8cb9e9f4b3f971ace6af28"
server_key_iv: "eb3bd6c32d594610f44490040bb48122"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:05.059582 22203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:40:05.087333 22203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:40:05.092721 22203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:40:05.093145 22203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:40:05.120764 22203 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:42009
I20260808 02:40:05.120783 22273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:42009 every 8 connection(s)
I20260808 02:40:05.122370 22203 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:40:05.127328 22274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:40:05.128922 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 22203
I20260808 02:40:05.129298 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:40:05.130450 10321 external_mini_cluster.cc:1428] Setting key a369278dd6a693c3de99d35b86cc8502
I20260808 02:40:05.148782 22274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564: Bootstrap starting.
I20260808 02:40:05.154027 22274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564: Neither blocks nor log segments found. Creating new log.
I20260808 02:40:05.155687 22274 log.cc:824] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564: Log is configured to *not* fsync() on all Append() calls
I20260808 02:40:05.160099 22274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564: No bootstrap required, opened a new log
Aug 08 02:40:05 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:40:05.171140 22274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324e30061ce84ae3b11004a985ec3564" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42009 } }
I20260808 02:40:05.171751 22274 raft_consensus.cc:374] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:40:05.171872 22274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 324e30061ce84ae3b11004a985ec3564, State: Initialized, Role: FOLLOWER
I20260808 02:40:05.172623 22274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324e30061ce84ae3b11004a985ec3564" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42009 } }
I20260808 02:40:05.172952 22274 raft_consensus.cc:388] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:40:05.173173 22274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:40:05.173388 22274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:40:05.176177 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:05.133234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39902 (local address 127.10.20.126:42009)
0808 02:40:05.145250 (+ 12016us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:05.145272 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:05.145338 (+ 66us) server_negotiation.cc:407] Connection header received
0808 02:40:05.148300 (+ 2962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:05.148338 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:05.148983 (+ 645us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:05.149557 (+ 574us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:05.151960 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:05.154909 (+ 2949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:05.157092 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:05.158188 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:05.158404 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:05.165270 (+ 6866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:05.165283 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:05.165308 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:05.165373 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:05.169897 (+ 4524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:05.171096 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:05.171106 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:05.171116 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:05.171370 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:05.171985 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:05.171991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:05.171994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:05.172794 (+ 800us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:05.173117 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:05.173997 (+ 880us) server_negotiation.cc:299] Negotiation successful
0808 02:40:05.174524 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11682,"thread_start_us":11364,"threads_started":1}
I20260808 02:40:05.177244 22274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324e30061ce84ae3b11004a985ec3564" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42009 } }
I20260808 02:40:05.178193 22274 leader_election.cc:302] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 324e30061ce84ae3b11004a985ec3564; no voters:
I20260808 02:40:05.178993 22274 leader_election.cc:288] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:40:05.179140 22279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:40:05.185029 22279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [term 1 LEADER]: Becoming Leader. State: Replica: 324e30061ce84ae3b11004a985ec3564, State: Running, Role: LEADER
I20260808 02:40:05.185789 22279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324e30061ce84ae3b11004a985ec3564" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42009 } }
I20260808 02:40:05.185923 22274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:40:05.195984 22280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "324e30061ce84ae3b11004a985ec3564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324e30061ce84ae3b11004a985ec3564" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42009 } } }
I20260808 02:40:05.196578 22280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [sys.catalog]: This master's current role is: LEADER
I20260808 02:40:05.197602 22281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 324e30061ce84ae3b11004a985ec3564. Latest consensus state: current_term: 1 leader_uuid: "324e30061ce84ae3b11004a985ec3564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324e30061ce84ae3b11004a985ec3564" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42009 } } }
I20260808 02:40:05.198067 22281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564 [sys.catalog]: This master's current role is: LEADER
I20260808 02:40:05.206732 22287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:40:05.214515 22287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:40:05.229070 22274 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 02:40:05.246258 22287 catalog_manager.cc:1347] Generated new cluster ID: 4ca7937800f445b38237f9457337b513
I20260808 02:40:05.246429 22287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:40:05.318410 22287 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:40:05.321530 22287 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:40:05.335856 22287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564: Generated new TSK 0
I20260808 02:40:05.337996 22287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:40:06.300979 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:45345/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42009
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:38637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:40:06 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156806, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 02:40:06.829202 22320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:40:06.829672 22320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:40:06.829926 22320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:40:06.842895 22320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:40:06.843158 22320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:40:06.843425 22320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:40:06.861112 22320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:38637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.20.84:45345/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:40:06.863046 22320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:40:06.866113 22320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:40:06.889137 22330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:06.888995 22331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:06.890336 22334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:40:06.892226 22320 server_base.cc:1034] running on GCE node
I20260808 02:40:06.893085 22320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:40:06.894244 22320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:40:06.895671 22320 hybrid_clock.cc:648] HybridClock initialized: now 1786156806895539 us; error 92 us; skew 500 ppm
I20260808 02:40:06.896339 22320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:40:06 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156806, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:40:06.901477 22320 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:40:06.903558 22320 webserver.cc:460] Webserver started at http://127.10.20.65:37685/ using document root <none> and password file <none>
I20260808 02:40:06.904403 22320 fs_manager.cc:359] Metadata directory not provided
I20260808 02:40:06.904565 22320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:40:06.904940 22320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:40:06 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156806, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:40:06.943425 22320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "49c33431007e4becb11152e1ab479d3e"
format_stamp: "Formatted at 2026-08-08 02:40:06 on dist-test-slave-8tdl"
server_key: "c47379667465e20a5c71e61f0dff9041"
server_key_iv: "f94ae137a84e8a692fe93cd7bca89985"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:06.944828 22320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "49c33431007e4becb11152e1ab479d3e"
format_stamp: "Formatted at 2026-08-08 02:40:06 on dist-test-slave-8tdl"
server_key: "c47379667465e20a5c71e61f0dff9041"
server_key_iv: "f94ae137a84e8a692fe93cd7bca89985"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:06.970362 22320 fs_manager.cc:691] Time spent creating directory manager: real 0.025s user 0.009s sys 0.012s
I20260808 02:40:07.000986 22341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:07.005260 22320 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.000s
I20260808 02:40:07.005543 22320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "49c33431007e4becb11152e1ab479d3e"
format_stamp: "Formatted at 2026-08-08 02:40:06 on dist-test-slave-8tdl"
server_key: "c47379667465e20a5c71e61f0dff9041"
server_key_iv: "f94ae137a84e8a692fe93cd7bca89985"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:07.006029 22320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:40:07.076192 22320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:40:07.083690 22320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:40:07.084266 22320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:40:07.092338 22320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:40:07.101657 22320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:40:07.101897 22320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 02:40:07.102154 22320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:40:07.102310 22320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:40:07 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156806, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:40:07.503203 22320 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:42131
I20260808 02:40:07.503309 22458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:42131 every 8 connection(s)
I20260808 02:40:07.504751 22320 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:40:07.506067 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 22320
I20260808 02:40:07.506372 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:40:07.507507 10321 external_mini_cluster.cc:1428] Setting key ee59534c5e4fc820765bcc3527d5ba6b
Aug 08 02:40:07 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156806, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:40:07.553745 22461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:07.508187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:43743 (local address 127.10.20.126:42009)
0808 02:40:07.528637 (+ 20450us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:07.528644 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:07.528668 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:40:07.528738 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:07.528743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:07.528838 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:07.531937 (+ 3099us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:07.532157 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:07.533338 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:07.536311 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:07.537211 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:07.537419 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:07.543092 (+ 5673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:07.543102 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:07.543107 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:07.543162 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:07.547436 (+ 4274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:07.549182 (+ 1746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:07.549190 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:07.549194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:07.549424 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:07.550530 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:07.550537 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:07.550541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:07.551063 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:07.551242 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:07.552747 (+ 1505us) server_negotiation.cc:299] Negotiation successful
0808 02:40:07.553202 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20269,"thread_start_us":20777,"threads_started":1}
I20260808 02:40:07.555104 22462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:07.508842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42009 (local address 127.10.20.65:43743)
0808 02:40:07.524238 (+ 15396us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:07.524330 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:07.527498 (+ 3168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:07.529494 (+ 1996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:07.529510 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:07.530475 (+ 965us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:40:07.531623 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:07.531658 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:07.533642 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:07.533648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:07.536057 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:07.536080 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:07.537559 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:07.537567 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:07.537902 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:07.539025 (+ 1123us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:40:07.539059 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:40:07.542630 (+ 3571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:40:07.547710 (+ 5080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:40:07.547726 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:40:07.547754 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:40:07.548940 (+ 1186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:40:07.549855 (+ 915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:40:07.549865 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:40:07.549872 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:40:07.550277 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:40:07.551338 (+ 1061us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:40:07.551349 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:40:07.551920 (+ 571us) client_negotiation.cc:769] Sending connection context
0808 02:40:07.552557 (+ 637us) client_negotiation.cc:240] Negotiation successful
0808 02:40:07.553225 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14964,"thread_start_us":537,"threads_started":1}
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:40:07.557632 22459 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42009
I20260808 02:40:07.558058 22459 heartbeater.cc:464] Registering TS with master...
I20260808 02:40:07.559258 22459 heartbeater.cc:511] Master 127.10.20.126:42009 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
I20260808 02:40:07.562629 22236 ts_manager.cc:194] Registered new tserver with Master: 49c33431007e4becb11152e1ab479d3e (127.10.20.65:42131)
I20260808 02:40:07.564961 22236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:43743
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
W20260808 02:40:07.614660 10321 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.20.66: real 0.103s user 0.000s sys 0.035s
I20260808 02:40:07.615661 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:45345/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42009
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:38637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:40:07 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156806, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
W20260808 02:40:08.173835 22465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:40:08.174350 22465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:40:08.174535 22465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:40:08.187356 22465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:40:08.187570 22465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:40:08.187767 22465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:40:08.205276 22465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:38637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.20.84:45345/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:40:08.207214 22465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:40:08.209041 22465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:40:08.227609 22484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:08.228132 22482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:08.228094 22480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:40:08.230906 22465 server_base.cc:1034] running on GCE node
I20260808 02:40:08.231788 22465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:40:08.233381 22465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:40:08.234834 22465 hybrid_clock.cc:648] HybridClock initialized: now 1786156808234739 us; error 79 us; skew 500 ppm
I20260808 02:40:08.235276 22465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:40:08 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156808, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:40:08.239825 22465 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:40:08.241884 22465 webserver.cc:460] Webserver started at http://127.10.20.66:36507/ using document root <none> and password file <none>
I20260808 02:40:08.242868 22465 fs_manager.cc:359] Metadata directory not provided
I20260808 02:40:08.243022 22465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:40:08.243414 22465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:40:08 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156808, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:40:08.265326 22465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "3613e6f4937f440c9098611c7510378c"
format_stamp: "Formatted at 2026-08-08 02:40:08 on dist-test-slave-8tdl"
server_key: "253591ae6abf5e08894378fb944178df"
server_key_iv: "b809a0c4c0f1b8c16b81fc8566d24aa3"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:08.266758 22465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "3613e6f4937f440c9098611c7510378c"
format_stamp: "Formatted at 2026-08-08 02:40:08 on dist-test-slave-8tdl"
server_key: "253591ae6abf5e08894378fb944178df"
server_key_iv: "b809a0c4c0f1b8c16b81fc8566d24aa3"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:08.274459 22465 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:40:08.294888 22492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:08.296860 22465 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:40:08.297114 22465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "3613e6f4937f440c9098611c7510378c"
format_stamp: "Formatted at 2026-08-08 02:40:08 on dist-test-slave-8tdl"
server_key: "253591ae6abf5e08894378fb944178df"
server_key_iv: "b809a0c4c0f1b8c16b81fc8566d24aa3"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:08.297405 22465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:40:08.330732 22465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:40:08.337580 22465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:40:08.338201 22465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:40:08.339700 22465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:40:08.341773 22465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:40:08.341893 22465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:08.342023 22465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:40:08.342090 22465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:08.391124 22465 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:34715
I20260808 02:40:08.391144 22612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:34715 every 8 connection(s)
I20260808 02:40:08.392848 22465 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:40:08.402009 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 22465
I20260808 02:40:08.402225 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:40:08.402813 10321 external_mini_cluster.cc:1428] Setting key 0f1fbb8440957422a36952d1be6b52f5
Aug 08 02:40:08 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156808, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:40:08.420080 22615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:08.396407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:43217 (local address 127.10.20.126:42009)
0808 02:40:08.397052 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:08.397058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:08.398179 (+ 1121us) server_negotiation.cc:407] Connection header received
0808 02:40:08.400278 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:08.400284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:08.400394 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:08.400524 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:08.402572 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:08.403649 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:08.405817 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:08.406236 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:08.406387 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:08.410833 (+ 4446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:08.410843 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:08.410851 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:08.410907 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:08.415476 (+ 4569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:08.416542 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:08.416551 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:08.416556 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:08.416773 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:08.417315 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:08.417323 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:08.417328 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:08.417757 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:08.417943 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:08.419129 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0808 02:40:08.419433 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":316,"threads_started":1}
I20260808 02:40:08.421622 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:08.397135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42009 (local address 127.10.20.66:43217)
0808 02:40:08.397978 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:08.398021 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:08.399949 (+ 1928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:08.400806 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:08.400816 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:08.401325 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:40:08.402281 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:08.402312 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:08.403832 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:08.403837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:08.405638 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:08.405654 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:08.406504 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:08.406513 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:08.406860 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:08.407725 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:40:08.407753 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:40:08.410491 (+ 2738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:40:08.415726 (+ 5235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:40:08.415736 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:40:08.415753 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:40:08.416380 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:40:08.416966 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:40:08.416970 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:40:08.416972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:40:08.417187 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:40:08.418037 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:40:08.418045 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:40:08.418502 (+ 457us) client_negotiation.cc:769] Sending connection context
0808 02:40:08.418978 (+ 476us) client_negotiation.cc:240] Negotiation successful
0808 02:40:08.419616 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":337,"threads_started":1}
I20260808 02:40:08.423838 22613 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42009
I20260808 02:40:08.424222 22613 heartbeater.cc:464] Registering TS with master...
I20260808 02:40:08.425179 22613 heartbeater.cc:511] Master 127.10.20.126:42009 requested a full tablet report, sending...
I20260808 02:40:08.427312 22236 ts_manager.cc:194] Registered new tserver with Master: 3613e6f4937f440c9098611c7510378c (127.10.20.66:34715)
I20260808 02:40:08.428678 22236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:43217
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:40:08.493127 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:45345/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42009
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:38637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:40:08.568755 22459 heartbeater.cc:503] Master 127.10.20.126:42009 was elected leader, sending a full tablet report...
W20260808 02:40:08.951822 22620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:40:08.952199 22620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:40:08.952380 22620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:40:08.963464 22620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:40:08.963829 22620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:40:08.964120 22620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:40:08.978320 22620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:38637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.20.84:45345/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:40:08.980654 22620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:40:08.982327 22620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:40:09.001344 22628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:09.002081 22626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:40:09.002100 22625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:40:09.005143 22620 server_base.cc:1034] running on GCE node
I20260808 02:40:09.006198 22620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:40:09.007941 22620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:40:09.011523 22620 hybrid_clock.cc:648] HybridClock initialized: now 1786156809011424 us; error 64 us; skew 500 ppm
I20260808 02:40:09.012110 22620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:40:09 dist-test-slave-8tdl krb5kdc[21735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156809, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:40:09.019187 22620 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:40:09.021139 22620 webserver.cc:460] Webserver started at http://127.10.20.67:42557/ using document root <none> and password file <none>
I20260808 02:40:09.022034 22620 fs_manager.cc:359] Metadata directory not provided
I20260808 02:40:09.022214 22620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:40:09.022590 22620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:40:09 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156809, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:40:09.043687 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "9050e2407cf443079d2ec38dd9add472"
format_stamp: "Formatted at 2026-08-08 02:40:09 on dist-test-slave-8tdl"
server_key: "dd62fc55b44f1593c9d09d39b51bf19a"
server_key_iv: "e6537a623d3b0d14ad7920ad1c533432"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:09.044837 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "9050e2407cf443079d2ec38dd9add472"
format_stamp: "Formatted at 2026-08-08 02:40:09 on dist-test-slave-8tdl"
server_key: "dd62fc55b44f1593c9d09d39b51bf19a"
server_key_iv: "e6537a623d3b0d14ad7920ad1c533432"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:09.051892 22620 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:40:09.070031 22635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:09.072309 22620 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:40:09.072520 22620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9050e2407cf443079d2ec38dd9add472"
format_stamp: "Formatted at 2026-08-08 02:40:09 on dist-test-slave-8tdl"
server_key: "dd62fc55b44f1593c9d09d39b51bf19a"
server_key_iv: "e6537a623d3b0d14ad7920ad1c533432"
server_key_version: "kuduclusterkey@0"
I20260808 02:40:09.072749 22620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:40:09.125080 22620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:40:09.130764 22620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:40:09.131166 22620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:40:09.132513 22620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:40:09.134297 22620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:40:09.134399 22620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:09.134505 22620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:40:09.134608 22620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:40:09.182042 22620 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:37987
I20260808 02:40:09.182086 22751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:37987 every 8 connection(s)
I20260808 02:40:09.183696 22620 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:40:09.188787 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 22620
I20260808 02:40:09.189038 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:40:09.189723 10321 external_mini_cluster.cc:1428] Setting key f748d67f9e653fb9e3fab7139f31dbb0
Aug 08 02:40:09 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156809, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:40:09.214954 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.188413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:53307 (local address 127.10.20.126:42009)
0808 02:40:09.189124 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.189133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.190277 (+ 1144us) server_negotiation.cc:407] Connection header received
0808 02:40:09.193143 (+ 2866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.193149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.193254 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.193391 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:09.195903 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.196721 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.199226 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.199750 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.199913 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.205133 (+ 5220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:09.205139 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:09.205142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:09.205191 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:09.209201 (+ 4010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.211253 (+ 2052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.211261 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.211264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.211534 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.212512 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.212519 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.212522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.213015 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:09.213228 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.214252 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.214541 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":342,"threads_started":1}
I20260808 02:40:09.215941 22755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.188953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42009 (local address 127.10.20.67:53307)
0808 02:40:09.190064 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:09.190122 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:09.192588 (+ 2466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:09.193749 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:09.193760 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:09.194287 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:40:09.195616 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.195647 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.196991 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.196995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.199004 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.199023 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.200088 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.200097 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.200446 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.201822 (+ 1376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:40:09.201851 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:40:09.204799 (+ 2948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:40:09.209594 (+ 4795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:40:09.209607 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:40:09.209631 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:40:09.210901 (+ 1270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:40:09.211803 (+ 902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:40:09.211808 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:40:09.211811 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:40:09.212260 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:40:09.213218 (+ 958us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:40:09.213225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:40:09.213652 (+ 427us) client_negotiation.cc:769] Sending connection context
0808 02:40:09.214009 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 02:40:09.214517 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":483,"threads_started":1}
I20260808 02:40:09.217782 22752 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42009
I20260808 02:40:09.218273 22752 heartbeater.cc:464] Registering TS with master...
I20260808 02:40:09.219308 22752 heartbeater.cc:511] Master 127.10.20.126:42009 requested a full tablet report, sending...
I20260808 02:40:09.221588 22236 ts_manager.cc:194] Registered new tserver with Master: 9050e2407cf443079d2ec38dd9add472 (127.10.20.67:37987)
I20260808 02:40:09.222747 22236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:53307
I20260808 02:40:09.235442 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:40:09.260048 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.241140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39908 (local address 127.10.20.126:42009)
0808 02:40:09.241396 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.241401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.242324 (+ 923us) server_negotiation.cc:407] Connection header received
0808 02:40:09.242447 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.242452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.242592 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.242869 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:09.244564 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.246116 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.248301 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.248828 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.248977 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.252687 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:09.252693 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:09.252697 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:09.252747 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:09.256168 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.257250 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.257255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.257257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.257433 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.258350 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.258354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.258356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.258765 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:09.258981 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.259544 (+ 563us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.259779 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260808 02:40:09.265455 22236 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39908:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:40:09.273587 22236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:40:09.325930 22766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.292630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:42131 (local address 127.0.0.1:47298)
0808 02:40:09.308814 (+ 16184us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:09.310264 (+ 1450us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:09.310608 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:09.315902 (+ 5294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:09.315910 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:09.315953 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:40:09.316843 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.316874 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.319681 (+ 2807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.319687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.323196 (+ 3509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.323214 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.324753 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.324761 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.324969 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.325044 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 02:40:09.325219 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 02:40:09.325455 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15859,"mutex_wait_us":264,"thread_start_us":15627,"threads_started":1}
I20260808 02:40:09.327081 22768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.292975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47298 (local address 127.10.20.65:42131)
0808 02:40:09.314071 (+ 21096us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.314083 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.314126 (+ 43us) server_negotiation.cc:407] Connection header received
0808 02:40:09.314279 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.314289 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.314823 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.315282 (+ 459us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:40:09.317219 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.319504 (+ 2285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.323405 (+ 3901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.324497 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.324695 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.324972 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.326402 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.326616 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20900,"thread_start_us":20708,"threads_started":1}
I20260808 02:40:09.327653 22770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.293072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34715 (local address 127.0.0.1:58988)
0808 02:40:09.314725 (+ 21653us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:09.314759 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:09.315669 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:09.317390 (+ 1721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:09.317399 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:09.317432 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:40:09.318238 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.318258 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.319990 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.319999 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.323266 (+ 3267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.323284 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.326471 (+ 3187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.326477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.326865 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.327001 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 02:40:09.327077 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 02:40:09.327248 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21432,"mutex_wait_us":282,"thread_start_us":22831,"threads_started":1}
I20260808 02:40:09.327816 22771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.294945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.10.20.67:37987)
0808 02:40:09.313353 (+ 18408us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.313371 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.316720 (+ 3349us) server_negotiation.cc:407] Connection header received
0808 02:40:09.316847 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.316854 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.317085 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.317317 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:40:09.318593 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.320196 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.323541 (+ 3345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.325780 (+ 2239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.325938 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.326209 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.327212 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.327412 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17723,"thread_start_us":18111,"threads_started":1}
I20260808 02:40:09.328672 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.293676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.10.20.66:34715)
0808 02:40:09.316140 (+ 22464us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.316154 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.316190 (+ 36us) server_negotiation.cc:407] Connection header received
0808 02:40:09.316307 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.316315 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.316849 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.317092 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:40:09.318486 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.319825 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.323530 (+ 3705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.325779 (+ 2249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.325938 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.326231 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.328084 (+ 1853us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.328289 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22230,"thread_start_us":21681,"threads_started":1}
I20260808 02:40:09.328814 22767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.294299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:37987 (local address 127.0.0.1:60048)
0808 02:40:09.316332 (+ 22033us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:09.316363 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:09.316520 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:09.317749 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:09.317752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:09.317779 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:40:09.318338 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.318349 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.320397 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.320402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.323266 (+ 2864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.323284 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.326460 (+ 3176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.326469 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.326867 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.326959 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 02:40:09.327073 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 02:40:09.328348 (+ 1275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21881,"mutex_wait_us":1270,"thread_start_us":19900,"threads_started":1}
I20260808 02:40:09.335225 22389 tablet_service.cc:1467] Processing CreateTablet for tablet badbd1b109614dfcb84aa4e7f711fb9e (DEFAULT_TABLE table=test-table [id=1fbb2ebe1c484d7d8cacea10bf1c783d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:40:09.335492 22544 tablet_service.cc:1467] Processing CreateTablet for tablet badbd1b109614dfcb84aa4e7f711fb9e (DEFAULT_TABLE table=test-table [id=1fbb2ebe1c484d7d8cacea10bf1c783d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:40:09.335487 22683 tablet_service.cc:1467] Processing CreateTablet for tablet badbd1b109614dfcb84aa4e7f711fb9e (DEFAULT_TABLE table=test-table [id=1fbb2ebe1c484d7d8cacea10bf1c783d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:40:09.337010 22389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet badbd1b109614dfcb84aa4e7f711fb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:40:09.337257 22544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet badbd1b109614dfcb84aa4e7f711fb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:40:09.337370 22683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet badbd1b109614dfcb84aa4e7f711fb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:40:09.354187 22772 tablet_bootstrap.cc:492] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Bootstrap starting.
I20260808 02:40:09.355804 22773 tablet_bootstrap.cc:492] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Bootstrap starting.
I20260808 02:40:09.359575 22774 tablet_bootstrap.cc:492] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Bootstrap starting.
I20260808 02:40:09.360018 22772 tablet_bootstrap.cc:654] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Neither blocks nor log segments found. Creating new log.
I20260808 02:40:09.360311 22773 tablet_bootstrap.cc:654] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Neither blocks nor log segments found. Creating new log.
I20260808 02:40:09.361774 22772 log.cc:824] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:40:09.361773 22773 log.cc:824] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:40:09.363646 22774 tablet_bootstrap.cc:654] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Neither blocks nor log segments found. Creating new log.
I20260808 02:40:09.364965 22774 log.cc:824] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Log is configured to *not* fsync() on all Append() calls
I20260808 02:40:09.366001 22772 tablet_bootstrap.cc:492] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: No bootstrap required, opened a new log
I20260808 02:40:09.366350 22772 ts_tablet_manager.cc:1397] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260808 02:40:09.368481 22774 tablet_bootstrap.cc:492] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: No bootstrap required, opened a new log
I20260808 02:40:09.368816 22774 ts_tablet_manager.cc:1397] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:40:09.372052 22773 tablet_bootstrap.cc:492] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: No bootstrap required, opened a new log
I20260808 02:40:09.372421 22773 ts_tablet_manager.cc:1397] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.001s
I20260808 02:40:09.378283 22772 raft_consensus.cc:348] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.378109 22774 raft_consensus.cc:348] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.378961 22772 raft_consensus.cc:374] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:40:09.379138 22772 raft_consensus.cc:729] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c33431007e4becb11152e1ab479d3e, State: Initialized, Role: FOLLOWER
I20260808 02:40:09.379199 22774 raft_consensus.cc:374] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:40:09.379472 22774 raft_consensus.cc:729] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9050e2407cf443079d2ec38dd9add472, State: Initialized, Role: FOLLOWER
I20260808 02:40:09.380015 22772 consensus_queue.cc:260] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.380316 22774 consensus_queue.cc:260] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.383342 22772 ts_tablet_manager.cc:1428] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Time spent starting tablet: real 0.017s user 0.015s sys 0.004s
I20260808 02:40:09.385739 22773 raft_consensus.cc:348] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.386407 22773 raft_consensus.cc:374] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:40:09.386536 22773 raft_consensus.cc:729] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3613e6f4937f440c9098611c7510378c, State: Initialized, Role: FOLLOWER
I20260808 02:40:09.387542 22773 consensus_queue.cc:260] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.389487 22752 heartbeater.cc:503] Master 127.10.20.126:42009 was elected leader, sending a full tablet report...
I20260808 02:40:09.389348 22613 heartbeater.cc:503] Master 127.10.20.126:42009 was elected leader, sending a full tablet report...
I20260808 02:40:09.390182 22773 ts_tablet_manager.cc:1428] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Time spent starting tablet: real 0.018s user 0.015s sys 0.002s
I20260808 02:40:09.392011 22774 ts_tablet_manager.cc:1428] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Time spent starting tablet: real 0.023s user 0.014s sys 0.007s
W20260808 02:40:09.395670 22614 tablet.cc:2369] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:40:09.436420 22753 tablet.cc:2369] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:40:09.481199 22779 raft_consensus.cc:482] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:40:09.481518 22779 raft_consensus.cc:504] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.483964 22779 leader_election.cc:288] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49c33431007e4becb11152e1ab479d3e (127.10.20.65:42131), 3613e6f4937f440c9098611c7510378c (127.10.20.66:34715)
I20260808 02:40:09.492991 22768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.484898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:55043 (local address 127.10.20.65:42131)
0808 02:40:09.485238 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.485246 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.485269 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:40:09.485365 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.485373 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.485475 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.485624 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:40:09.486417 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.487918 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.490589 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.491920 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.492063 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.492125 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.492658 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.492783 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260808 02:40:09.493095 22755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.484341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:42131 (local address 127.10.20.67:55043)
0808 02:40:09.484952 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:09.484979 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:09.485169 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:09.485696 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:09.485704 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:09.485778 (+ 74us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:40:09.486186 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.486204 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.488080 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.488087 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.490267 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.490283 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.492122 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.492130 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.492387 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.492434 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 02:40:09.492571 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 02:40:09.492742 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343}
I20260808 02:40:09.494943 22781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.484639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34715 (local address 127.10.20.67:58687)
0808 02:40:09.486045 (+ 1406us) negotiation.cc:107] Waiting for socket to connect
0808 02:40:09.486076 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:40:09.486267 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:40:09.487063 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:40:09.487068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:40:09.487174 (+ 106us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:40:09.487637 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.487651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.489457 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.489462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.491600 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:40:09.491617 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.493742 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.493748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:40:09.494008 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.494044 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:40:09.494172 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 02:40:09.494347 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1202,"thread_start_us":751,"threads_started":1}
I20260808 02:40:09.494997 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.484905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:58687 (local address 127.10.20.66:34715)
0808 02:40:09.485144 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.485151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.486233 (+ 1082us) server_negotiation.cc:407] Connection header received
0808 02:40:09.486468 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.486479 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.486614 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.486813 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:40:09.487862 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.489080 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.491946 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.493468 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.493681 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.493763 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.494351 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.494544 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:40:09.494720 22410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "badbd1b109614dfcb84aa4e7f711fb9e" candidate_uuid: "9050e2407cf443079d2ec38dd9add472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c33431007e4becb11152e1ab479d3e" is_pre_election: true
I20260808 02:40:09.496059 22410 raft_consensus.cc:2454] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9050e2407cf443079d2ec38dd9add472 in term 0.
I20260808 02:40:09.496542 22564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "badbd1b109614dfcb84aa4e7f711fb9e" candidate_uuid: "9050e2407cf443079d2ec38dd9add472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3613e6f4937f440c9098611c7510378c" is_pre_election: true
I20260808 02:40:09.497087 22637 leader_election.cc:302] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c33431007e4becb11152e1ab479d3e, 9050e2407cf443079d2ec38dd9add472; no voters:
I20260808 02:40:09.497162 22564 raft_consensus.cc:2454] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9050e2407cf443079d2ec38dd9add472 in term 0.
I20260808 02:40:09.497661 22779 raft_consensus.cc:2781] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:40:09.497826 22779 raft_consensus.cc:482] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:40:09.497968 22779 raft_consensus.cc:3037] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:40:09.500595 22779 raft_consensus.cc:504] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.501277 22779 leader_election.cc:288] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [CANDIDATE]: Term 1 election: Requested vote from peers 49c33431007e4becb11152e1ab479d3e (127.10.20.65:42131), 3613e6f4937f440c9098611c7510378c (127.10.20.66:34715)
I20260808 02:40:09.502014 22410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "badbd1b109614dfcb84aa4e7f711fb9e" candidate_uuid: "9050e2407cf443079d2ec38dd9add472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c33431007e4becb11152e1ab479d3e"
I20260808 02:40:09.502225 22410 raft_consensus.cc:3037] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:40:09.502140 22564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "badbd1b109614dfcb84aa4e7f711fb9e" candidate_uuid: "9050e2407cf443079d2ec38dd9add472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3613e6f4937f440c9098611c7510378c"
I20260808 02:40:09.502712 22564 raft_consensus.cc:3037] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:40:09.505167 22410 raft_consensus.cc:2454] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9050e2407cf443079d2ec38dd9add472 in term 1.
I20260808 02:40:09.505733 22637 leader_election.cc:302] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c33431007e4becb11152e1ab479d3e, 9050e2407cf443079d2ec38dd9add472; no voters:
I20260808 02:40:09.506170 22779 raft_consensus.cc:2781] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:40:09.506798 22779 raft_consensus.cc:686] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 1 LEADER]: Becoming Leader. State: Replica: 9050e2407cf443079d2ec38dd9add472, State: Running, Role: LEADER
I20260808 02:40:09.507560 22564 raft_consensus.cc:2454] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9050e2407cf443079d2ec38dd9add472 in term 1.
I20260808 02:40:09.507856 22779 consensus_queue.cc:237] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } }
I20260808 02:40:09.514258 22234 catalog_manager.cc:5495] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9050e2407cf443079d2ec38dd9add472 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "9050e2407cf443079d2ec38dd9add472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9050e2407cf443079d2ec38dd9add472" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 37987 } health_report { overall_health: HEALTHY } } }
W20260808 02:40:09.536260 22460 tablet.cc:2369] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:40:09.579535 22771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.572940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60062 (local address 127.10.20.67:37987)
0808 02:40:09.573117 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.573121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.573141 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:40:09.573382 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.573388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.573502 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.573652 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:40:09.574202 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.575075 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.576733 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.577304 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.577419 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.578037 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:40:09.578746 (+ 709us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:40:09.578882 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.579199 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.579291 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:40:09.589512 22410 raft_consensus.cc:1261] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 1 FOLLOWER]: Refusing update from remote peer 9050e2407cf443079d2ec38dd9add472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:40:09.590631 22564 raft_consensus.cc:1261] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 1 FOLLOWER]: Refusing update from remote peer 9050e2407cf443079d2ec38dd9add472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:40:09.590839 22782 consensus_queue.cc:1035] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c33431007e4becb11152e1ab479d3e" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:40:09.591681 22779 consensus_queue.cc:1035] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3613e6f4937f440c9098611c7510378c" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:40:09.609822 22785 mvcc.cc:205] Tried to move back new op lower bound from 7316098292065259520 to 7316098291749416960. Current Snapshot: MvccSnapshot[applied={T|T < 7316098292065259520}]
I20260808 02:40:09.613230 22787 mvcc.cc:205] Tried to move back new op lower bound from 7316098292065259520 to 7316098291749416960. Current Snapshot: MvccSnapshot[applied={T|T < 7316098292065259520}]
I20260808 02:40:09.624914 22234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:40:09.625231 22234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:40:09.629892 22234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 324e30061ce84ae3b11004a985ec3564: Sending DeleteTablet for 3 replicas of tablet badbd1b109614dfcb84aa4e7f711fb9e
I20260808 02:40:09.631471 22544 tablet_service.cc:1514] Processing DeleteTablet for tablet badbd1b109614dfcb84aa4e7f711fb9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:40:09 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:58988
I20260808 02:40:09.631465 22389 tablet_service.cc:1514] Processing DeleteTablet for tablet badbd1b109614dfcb84aa4e7f711fb9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:40:09 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:47298
I20260808 02:40:09.632412 22683 tablet_service.cc:1514] Processing DeleteTablet for tablet badbd1b109614dfcb84aa4e7f711fb9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:40:09 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:60048
I20260808 02:40:09.633009 22796 tablet_replica.cc:330] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: stopping tablet replica
I20260808 02:40:09.633561 22796 raft_consensus.cc:2229] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:40:09.634128 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 22320
I20260808 02:40:09.634174 22796 raft_consensus.cc:2258] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:40:09.636982 22796 ts_tablet_manager.cc:1905] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:40:09.645810 22795 tablet_replica.cc:330] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: stopping tablet replica
I20260808 02:40:09.648010 22796 ts_tablet_manager.cc:1918] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:40:09.648278 22796 log.cc:1196] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/badbd1b109614dfcb84aa4e7f711fb9e
I20260808 02:40:09.649111 22797 tablet_replica.cc:330] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: stopping tablet replica
I20260808 02:40:09.648986 22796 ts_tablet_manager.cc:1939] T badbd1b109614dfcb84aa4e7f711fb9e P 49c33431007e4becb11152e1ab479d3e: Deleting consensus metadata
I20260808 02:40:09.650132 22797 raft_consensus.cc:2229] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:40:09.651350 22797 raft_consensus.cc:2258] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:40:09.647460 22795 raft_consensus.cc:2229] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:40:09.653003 22795 raft_consensus.cc:2258] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:40:09.653800 22220 catalog_manager.cc:4841] TS 49c33431007e4becb11152e1ab479d3e (127.10.20.65:42131): tablet badbd1b109614dfcb84aa4e7f711fb9e (table test-table [id=1fbb2ebe1c484d7d8cacea10bf1c783d]) successfully deleted
I20260808 02:40:09.655121 22797 ts_tablet_manager.cc:1905] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:40:09.656414 22795 ts_tablet_manager.cc:1905] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 02:40:09 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:40:09.663872 22797 ts_tablet_manager.cc:1918] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:40:09.664158 22797 log.cc:1196] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/badbd1b109614dfcb84aa4e7f711fb9e
I20260808 02:40:09.665027 22797 ts_tablet_manager.cc:1939] T badbd1b109614dfcb84aa4e7f711fb9e P 9050e2407cf443079d2ec38dd9add472: Deleting consensus metadata
I20260808 02:40:09.666173 22795 ts_tablet_manager.cc:1918] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:40:09.666477 22795 log.cc:1196] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/badbd1b109614dfcb84aa4e7f711fb9e
I20260808 02:40:09.667353 22221 catalog_manager.cc:4841] TS 9050e2407cf443079d2ec38dd9add472 (127.10.20.67:37987): tablet badbd1b109614dfcb84aa4e7f711fb9e (table test-table [id=1fbb2ebe1c484d7d8cacea10bf1c783d]) successfully deleted
I20260808 02:40:09.668077 22795 ts_tablet_manager.cc:1939] T badbd1b109614dfcb84aa4e7f711fb9e P 3613e6f4937f440c9098611c7510378c: Deleting consensus metadata
I20260808 02:40:09.671346 22222 catalog_manager.cc:4841] TS 3613e6f4937f440c9098611c7510378c (127.10.20.66:34715): tablet badbd1b109614dfcb84aa4e7f711fb9e (table test-table [id=1fbb2ebe1c484d7d8cacea10bf1c783d]) successfully deleted
I20260808 02:40:09.677394 22768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.637700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47304 (local address 127.10.20.65:42131)
0808 02:40:09.637966 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.637976 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.647685 (+ 9709us) server_negotiation.cc:407] Connection header received
0808 02:40:09.648196 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.648203 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.648341 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.648472 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:09.651873 (+ 3401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.653227 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.655877 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.656633 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.656761 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.663820 (+ 7059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:09.663847 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:09.663870 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:09.663932 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:09.670847 (+ 6915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.672687 (+ 1840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.672700 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.672703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.673211 (+ 508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.674334 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.674339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.674342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.675309 (+ 967us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:09.675728 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.676452 (+ 724us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.677012 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 02:40:09.678203 22453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:40:09.790757 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 22320
I20260808 02:40:09.822567 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 22465
Aug 08 02:40:09 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:40:09.845719 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.823646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58998 (local address 127.10.20.66:34715)
0808 02:40:09.823851 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.823856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.823915 (+ 59us) server_negotiation.cc:407] Connection header received
0808 02:40:09.824185 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.824200 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.824335 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.824468 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:09.826371 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.827356 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.830006 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.830470 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.830630 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:09.837928 (+ 7298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:09.837947 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:09.837965 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:09.838029 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:09.841942 (+ 3913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.842972 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.842981 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.842984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.843154 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:09.843607 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:09.843613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:09.843617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:09.844108 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:09.844664 (+ 556us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:09.845030 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 02:40:09.845319 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:40:09.846657 22607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:40:09.952697 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 22465
I20260808 02:40:09.982993 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 22620
Aug 08 02:40:10 dist-test-slave-8tdl krb5kdc[21735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:40:10.016969 22771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:40:09.984443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.10.20.67:37987)
0808 02:40:09.984632 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 02:40:09.984637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:40:09.984657 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:40:09.984926 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:40:09.984931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:40:09.985108 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:40:09.985217 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:40:09.987997 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.989515 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.991564 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:40:09.992680 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:40:09.992985 (+ 305us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:40:10.005062 (+ 12077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:40:10.005092 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:40:10.005117 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:40:10.005206 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:40:10.012260 (+ 7054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:10.013543 (+ 1283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:10.013561 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:10.013565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:10.013825 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:40:10.014392 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:40:10.014402 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:40:10.014408 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:40:10.015171 (+ 763us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:40:10.015592 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0808 02:40:10.016083 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 02:40:10.016425 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:40:10.017825 22746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:40:10.186854 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 22620
I20260808 02:40:10.213745 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 22203
I20260808 02:40:10.215101 22268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:40:10.345700 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 22203
I20260808 02:40:10.375478 10321 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 02:40:10.724329 10321 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 02:40:10.724792 10321 mini_ranger.cc:66] Stopping Ranger...
I20260808 02:40:11.077627 10321 mini_ranger.cc:68] Stopped Ranger
2026-08-08 02:40:11.078 UTC [21766] LOG: received smart shutdown request
2026-08-08 02:40:11.085 UTC [21766] LOG: background worker "logical replication launcher" (PID 21774) exited with exit code 1
2026-08-08 02:40:11.085 UTC [21769] LOG: shutting down
2026-08-08 02:40:11.414 UTC [21766] LOG: database system is shut down
2026-08-08T02:40:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (61048 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:40:11 dist-test-slave-8tdl krb5kdc[22811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:40:11 dist-test-slave-8tdl krb5kdc[22811](info): set up 2 sockets
Aug 08 02:40:11 dist-test-slave-8tdl krb5kdc[22811](info): commencing operation
krb5kdc: starting...
W20260808 02:40:12.857918 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.004s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:40:13 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:40:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:40:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/rangeradmin_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/rangeradmin_127.10.20.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/rangerlookup_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/rangerlookup_127.10.20.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
I20260808 02:40:13.395310 10321 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksj7NWU/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/postgres -l logfile start
2026-08-08 02:40:17.199 UTC [22843] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 02:40:17.199 UTC [22843] LOG: listening on IPv4 address "127.10.20.84", port 37749
2026-08-08 02:40:17.205 UTC [22843] LOG: listening on Unix socket "/tmp/.s.PGSQL.37749"
2026-08-08 02:40:17.235 UTC [22845] LOG: database system was shut down at 2026-08-08 02:40:14 UTC
2026-08-08 02:40:17.240 UTC [22843] LOG: database system is ready to accept connections
I20260808 02:40:18.327013 10321 mini_postgres.cc:96] Postgres bound to 37749
2026-08-08 02:40:18.355 UTC [22855] FATAL: database "slave" does not exist
127.10.20.84:37749 - accepting connections
I20260808 02:40:18.356631 10321 mini_ranger.cc:161] Starting Ranger...
I20260808 02:40:18.396919 10321 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 02:40:19.289142 10321 mini_ranger.cc:87] Created ranger Postgres database
I20260808 02:40:19.289283 10321 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-admin
2026-08-08 02:40:19,613 [I] DB FLAVOR :POSTGRES
2026-08-08 02:40:19,613 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:40:19,614 [I] Checking connection..
2026-08-08 02:40:19,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 02:40:19,893 [I] Checking connection passed.
2026-08-08 02:40:19,893 [I] --------- Verifying version history table ---------
2026-08-08 02:40:19,893 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:40:20,225 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:40:20,226 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:40:20,515 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 02:40:20,515 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 02:40:20,516 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 02:40:20.837 UTC [22923] WARNING: there is no transaction in progress
2026-08-08 02:40:20,846 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 02:40:20,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 02:40:21,141 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 02:40:21,141 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:40:21,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 02:40:21,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 02:40:21,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8tdl.c.gcp-upstream.internal','N') ;"
2026-08-08 02:40:22,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:40:22,372 [I] Table x_portal_user does not exist in database ranger
2026-08-08 02:40:22,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:40:22,724 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 02:40:22,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:40:23,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:40:23,388 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 02:40:23,389 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 02:40:25.057 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.083 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.110 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.133 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.162 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.189 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.284 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.299 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.324 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.342 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.358 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.387 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.402 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.415 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.430 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:25.446 UTC [23035] WARNING: there is no transaction in progress
2026-08-08 02:40:26,608 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 02:40:26,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 02:40:26,906 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 02:40:26,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 02:40:27,215 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 02:40:27,216 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 02:40:27,519 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 02:40:27,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 02:40:27,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 02:40:28,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8tdl.c.gcp-upstream.internal';"
2026-08-08 02:40:28,437 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 02:40:28,438 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 02:40:28,771 [I] DB_PATCHES have already been applied
I20260808 02:40:28.778863 10321 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksj7NWU/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 02:40:28.778980 10321 mini_ranger.cc:193] Using host: 127.10.20.84
I20260808 02:40:28.807595 10321 mini_ranger.cc:227] Ranger admin URL: http://127.10.20.84:46841
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:40:29 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 02:40:30.119468 10321 mini_ranger.cc:160] Time spent starting Ranger: real 11.763s user 0.000s sys 0.085s
Aug 08, 2026 2:40:56 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:40:56 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:40:56 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:40:56 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:40:57 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 02:40:58.149127 10321 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.20.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.20.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/rangerkms_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.20.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/rangerkms_127.10.20.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.20.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.20.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.20.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/HTTP_127.10.20.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 02:40:58 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156858, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 02:40:58.437328 10321 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 02:40:58.475934 10321 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 02:40:59.883081 10321 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 02:40:59.883229 10321 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms
I20260808 02:40:59.883287 10321 mini_ranger_kms.cc:227] Using postgres at 127.10.20.84:37749
2026-08-08 02:41:00,365 [I] DB FLAVOR :POSTGRES
2026-08-08 02:41:00,366 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 02:41:00,366 [I] Checking connection
2026-08-08 02:41:00,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 02:41:00,708 [I] connection success
2026-08-08 02:41:00,708 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 02:41:00,708 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 02:41:00,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 02:41:01,021 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 02:41:01,022 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 02:41:01,022 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 02:41:01,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.20.84:37749/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 02:41:01,395 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 02:41:02.068379 10321 mini_ranger_kms.cc:310] Created kms service
I20260808 02:41:02.319478 10321 mini_ranger_kms.cc:326] Created kudu user
I20260808 02:41:02.376693 10321 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 02:41:02 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156858, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:02.951906 10321 mini_ranger_kms.cc:384] Added ranger policy
I20260808 02:41:02.952312 10321 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksj7NWU/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksj7NWU/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 02:41:02.952370 10321 mini_ranger_kms.cc:240] Using host: 127.10.20.84
I20260808 02:41:02.988127 10321 mini_ranger_kms.cc:276] Ranger KMS PID: 23227
I20260808 02:41:02.988579 10321 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.20.84:58459
Aug 08, 2026 2:41:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:41:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:41:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:41:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:41:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:41:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 02:41:05.698390 10321 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.261s user 0.103s sys 0.435s
I20260808 02:41:05.699148 10321 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 02:41:05.699368 10321 mini_ranger_kms.cc:401] 127.10.20.84:58459/kms/v1/keys
Aug 08 02:41:06 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156866, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.20.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 02:41:06 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156866, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.20.84@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
Aug 08 02:41:07 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156866, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.20.84@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
Aug 08 02:41:09 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:41:09.970068 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46353
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:46353
--ranger_config_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:10.407641 23281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:10.408113 23281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:10.408295 23281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:10.419209 23281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:10.419454 23281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:10.419572 23281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:10.419683 23281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:10.419795 23281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:10.434442 23281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.20.84:58459/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:46353
--ranger_config_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:10.437041 23281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:10.439417 23281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:10.461000 23286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:10.462064 23287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:10.462143 23289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:10.464735 23281 server_base.cc:1034] running on GCE node
I20260808 02:41:10.466159 23281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:10.468545 23281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:10.469823 23281 hybrid_clock.cc:648] HybridClock initialized: now 1786156870469757 us; error 61 us; skew 500 ppm
I20260808 02:41:10.470424 23281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:10 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156870, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:10.476261 23281 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:10.479648 23281 webserver.cc:460] Webserver started at http://127.10.20.126:37839/ using document root <none> and password file <none>
I20260808 02:41:10.481042 23281 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:10.481344 23281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:10.481912 23281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:41:10 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156870, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:10.555665 23281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "b8a76b0890d14954a1085b9a42b80ec2"
format_stamp: "Formatted at 2026-08-08 02:41:10 on dist-test-slave-8tdl"
server_key: "c774fc1e2d41e75dd6526866e1f6853c"
server_key_iv: "71b3f359737fdcfbdfc60bd1af46f54d"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:10.557022 23281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "b8a76b0890d14954a1085b9a42b80ec2"
format_stamp: "Formatted at 2026-08-08 02:41:10 on dist-test-slave-8tdl"
server_key: "c774fc1e2d41e75dd6526866e1f6853c"
server_key_iv: "71b3f359737fdcfbdfc60bd1af46f54d"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:10.565656 23281 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260808 02:41:10.588805 23297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:10.590884 23281 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:41:10.591146 23281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "b8a76b0890d14954a1085b9a42b80ec2"
format_stamp: "Formatted at 2026-08-08 02:41:10 on dist-test-slave-8tdl"
server_key: "c774fc1e2d41e75dd6526866e1f6853c"
server_key_iv: "71b3f359737fdcfbdfc60bd1af46f54d"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:10.591428 23281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:10.616559 23281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:10.623157 23281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:10.623695 23281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:10.651993 23281 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:46353
I20260808 02:41:10.652371 23351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:46353 every 8 connection(s)
I20260808 02:41:10.653913 23281 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:10.654924 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 23281
I20260808 02:41:10.655232 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:41:10.656564 10321 external_mini_cluster.cc:1428] Setting key ed5ed634076bcd77fc78424ccbdcaf16
I20260808 02:41:10.659528 23352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:10.683144 23352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Bootstrap starting.
Aug 08 02:41:10 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:10.689225 23352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:10.691236 23352 log.cc:824] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:10.697635 23352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: No bootstrap required, opened a new log
I20260808 02:41:10.701251 23355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:10.660553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.10.20.126:46353)
0808 02:41:10.671843 (+ 11290us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:10.671859 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:10.671914 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:41:10.673955 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:10.673986 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:10.674523 (+ 537us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:10.675148 (+ 625us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:10.676798 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:10.678231 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:10.679828 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:10.680609 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:10.681004 (+ 395us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:10.688230 (+ 7226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:10.688243 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:10.688262 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:10.688333 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:10.694383 (+ 6050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:10.695455 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:10.695463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:10.695470 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:10.695650 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:10.696168 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:10.696173 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:10.696178 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:10.696957 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:10.697346 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:10.698619 (+ 1273us) server_negotiation.cc:299] Negotiation successful
0808 02:41:10.699269 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11031,"thread_start_us":10213,"threads_started":1}
I20260808 02:41:10.709647 23352 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:10.710188 23352 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:10.710321 23352 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a76b0890d14954a1085b9a42b80ec2, State: Initialized, Role: FOLLOWER
I20260808 02:41:10.711020 23352 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:10.711493 23352 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:10.711902 23352 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:10.712155 23352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:10.715291 23352 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:10.716112 23352 leader_election.cc:302] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a76b0890d14954a1085b9a42b80ec2; no voters:
I20260808 02:41:10.717025 23352 leader_election.cc:288] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:41:10.717207 23357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:10.719602 23357 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 LEADER]: Becoming Leader. State: Replica: b8a76b0890d14954a1085b9a42b80ec2, State: Running, Role: LEADER
I20260808 02:41:10.720302 23357 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:10.722235 23352 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:10.725157 23358 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a76b0890d14954a1085b9a42b80ec2. Latest consensus state: current_term: 1 leader_uuid: "b8a76b0890d14954a1085b9a42b80ec2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } } }
I20260808 02:41:10.725610 23358 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:10.727103 23359 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8a76b0890d14954a1085b9a42b80ec2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } } }
I20260808 02:41:10.728168 23359 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:10.734251 23362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:10.741847 23362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:10.742998 23352 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 02:41:10.779103 23362 catalog_manager.cc:1347] Generated new cluster ID: 5a820b69387c4dd7a189ea62b48001fc
I20260808 02:41:10.779281 23362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:10.805281 23362 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:41:10.807523 23362 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:10.828912 23362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Generated new TSK 0
I20260808 02:41:10.831071 23362 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
W20260808 02:41:11.755892 10321 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.20.65: real 0.102s user 0.007s sys 0.030s
I20260808 02:41:11.758661 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46353
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:41:12 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 02:41:12.243155 23397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:12.243613 23397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:12.243785 23397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:12.256314 23397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:12.256493 23397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:12.256702 23397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:41:12.273952 23397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.20.84:58459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:12.275818 23397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:12.277628 23397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:12.297034 23409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:12.297887 23410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:12.306667 23414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:12.308351 23397 server_base.cc:1034] running on GCE node
I20260808 02:41:12.309275 23397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:12.310732 23397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:12.312088 23397 hybrid_clock.cc:648] HybridClock initialized: now 1786156872312018 us; error 64 us; skew 500 ppm
I20260808 02:41:12.312544 23397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:12 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:12.317414 23397 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:41:12.323251 23397 webserver.cc:460] Webserver started at http://127.10.20.65:33989/ using document root <none> and password file <none>
I20260808 02:41:12.324458 23397 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:12.324621 23397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:12.325031 23397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:41:12 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:12.360647 23397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "5fcc7ad8628e44bea74a3f6bd758bab7"
format_stamp: "Formatted at 2026-08-08 02:41:12 on dist-test-slave-8tdl"
server_key: "ad6aafe55771349a5680af7d287c1bbc"
server_key_iv: "d17a7128fc2576e3a298ef098f458fed"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:12.361866 23397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "5fcc7ad8628e44bea74a3f6bd758bab7"
format_stamp: "Formatted at 2026-08-08 02:41:12 on dist-test-slave-8tdl"
server_key: "ad6aafe55771349a5680af7d287c1bbc"
server_key_iv: "d17a7128fc2576e3a298ef098f458fed"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:12.369573 23397 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 02:41:12.395499 23420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:12.397854 23397 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260808 02:41:12.398110 23397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "5fcc7ad8628e44bea74a3f6bd758bab7"
format_stamp: "Formatted at 2026-08-08 02:41:12 on dist-test-slave-8tdl"
server_key: "ad6aafe55771349a5680af7d287c1bbc"
server_key_iv: "d17a7128fc2576e3a298ef098f458fed"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:12.398538 23397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:12.434825 23397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:12.443192 23397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:12.443747 23397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:12.455245 23397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:12.464439 23397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:12.464675 23397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:12.464908 23397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:12.465044 23397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:41:12 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:13.147578 23397 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:33521
I20260808 02:41:13.147631 23536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:33521 every 8 connection(s)
I20260808 02:41:13.150151 23397 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:41:13.151769 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 23397
I20260808 02:41:13.152070 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:41:13.152966 10321 external_mini_cluster.cc:1428] Setting key 874085cf7d5b1eb07caa855702563196
Aug 08 02:41:13 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:13.227339 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:13.173339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46353 (local address 127.10.20.65:44713)
0808 02:41:13.196093 (+ 22754us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:13.196170 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:13.199135 (+ 2965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:13.200579 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:13.200595 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:13.201392 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:13.202514 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:13.202555 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:13.204527 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:13.204536 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:13.207474 (+ 2938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:13.207575 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:13.209241 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:13.209252 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:13.209645 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:13.210648 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:13.210712 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:13.214114 (+ 3402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:13.220401 (+ 6287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:13.220415 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:13.220442 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:13.221235 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:13.221906 (+ 671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:13.221913 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:13.221919 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:13.222238 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:13.223179 (+ 941us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:13.223191 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:13.223806 (+ 615us) client_negotiation.cc:769] Sending connection context
0808 02:41:13.224202 (+ 396us) client_negotiation.cc:240] Negotiation successful
0808 02:41:13.224969 (+ 767us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22340,"thread_start_us":25062,"threads_started":1}
I20260808 02:41:13.229002 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:13.174112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:44713 (local address 127.10.20.126:46353)
0808 02:41:13.195217 (+ 21105us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:13.195227 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:13.199667 (+ 4440us) server_negotiation.cc:407] Connection header received
0808 02:41:13.199760 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:13.199768 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:13.199895 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:13.200030 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:13.202908 (+ 2878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:13.204250 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:13.207801 (+ 3551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:13.208648 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:13.208790 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:13.214469 (+ 5679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:13.214480 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:13.214488 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:13.214560 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:13.220094 (+ 5534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:13.221432 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:13.221441 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:13.221447 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:13.221687 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:13.222392 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:13.222399 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:13.222405 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:13.222911 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:13.223079 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:13.228115 (+ 5036us) server_negotiation.cc:299] Negotiation successful
0808 02:41:13.228466 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20919,"thread_start_us":21130,"threads_started":1}
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
I20260808 02:41:13.232074 23537 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46353
I20260808 02:41:13.232486 23537 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:13.234050 23537 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:13.237375 23316 ts_manager.cc:194] Registered new tserver with Master: 5fcc7ad8628e44bea74a3f6bd758bab7 (127.10.20.65:33521)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
I20260808 02:41:13.239849 23316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:44713
Aug 08 02:41:13 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
W20260808 02:41:13.299958 10321 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.20.66: real 0.144s user 0.000s sys 0.033s
I20260808 02:41:13.301007 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46353
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:13.829793 23545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:13.830139 23545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:13.830309 23545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:13.841033 23545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:13.841197 23545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:13.841421 23545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:41:13.854650 23545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.20.84:58459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:13.856221 23545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:13.858172 23545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:13.877130 23559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:13.877509 23560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:13.877878 23562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:13.878389 23545 server_base.cc:1034] running on GCE node
I20260808 02:41:13.879281 23545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:13.880870 23545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:13.882308 23545 hybrid_clock.cc:648] HybridClock initialized: now 1786156873882231 us; error 78 us; skew 500 ppm
I20260808 02:41:13.882793 23545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:13 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156873, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:13.889324 23545 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:41:13.891642 23545 webserver.cc:460] Webserver started at http://127.10.20.66:32797/ using document root <none> and password file <none>
I20260808 02:41:13.892765 23545 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:13.892973 23545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:13.893381 23545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:41:13 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156873, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:13.915818 23545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "8f669ceb0f4348589974a3ed1e7d1c3b"
format_stamp: "Formatted at 2026-08-08 02:41:13 on dist-test-slave-8tdl"
server_key: "2da92ad94cf66a65095dfcc80a39dfd2"
server_key_iv: "bb35bd6e2d168280e81a88836e8cbe96"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:13.916844 23545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "8f669ceb0f4348589974a3ed1e7d1c3b"
format_stamp: "Formatted at 2026-08-08 02:41:13 on dist-test-slave-8tdl"
server_key: "2da92ad94cf66a65095dfcc80a39dfd2"
server_key_iv: "bb35bd6e2d168280e81a88836e8cbe96"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:13.924353 23545 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:41:13.947731 23569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:13.950083 23545 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.000s
I20260808 02:41:13.950399 23545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "8f669ceb0f4348589974a3ed1e7d1c3b"
format_stamp: "Formatted at 2026-08-08 02:41:13 on dist-test-slave-8tdl"
server_key: "2da92ad94cf66a65095dfcc80a39dfd2"
server_key_iv: "bb35bd6e2d168280e81a88836e8cbe96"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:13.950749 23545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:13.977619 23545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:13.984411 23545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:13.984869 23545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:13.986757 23545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:13.989164 23545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:13.989352 23545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:13.989494 23545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:13.989564 23545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:14.038578 23545 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:44119
I20260808 02:41:14.038595 23685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:44119 every 8 connection(s)
I20260808 02:41:14.040154 23545 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:41:14.048365 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 23545
I20260808 02:41:14.048597 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:41:14.049196 10321 external_mini_cluster.cc:1428] Setting key 078300f366dc404f2377d6e22013f5f8
Aug 08 02:41:14 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156873, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:14.069039 23688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:14.043989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:34251 (local address 127.10.20.126:46353)
0808 02:41:14.044559 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:14.044564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:14.045706 (+ 1142us) server_negotiation.cc:407] Connection header received
0808 02:41:14.047836 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:14.047842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:14.047975 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:14.048093 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:14.050340 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.051302 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.054889 (+ 3587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.055350 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.055490 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:14.060723 (+ 5233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:14.060730 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:14.060733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:14.060785 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:14.064294 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.065767 (+ 1473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.065780 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.065782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.066007 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.066716 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.066725 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.066729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.067190 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:14.067400 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:14.068311 (+ 911us) server_negotiation.cc:299] Negotiation successful
0808 02:41:14.068601 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":298,"threads_started":1}
I20260808 02:41:14.070147 23689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:14.044633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46353 (local address 127.10.20.66:34251)
0808 02:41:14.045503 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:14.045558 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:14.047467 (+ 1909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:14.048461 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:14.048476 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:14.049168 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:14.050117 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:14.050142 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.051506 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.051513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:14.054549 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:14.054597 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.055685 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.055696 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:14.056104 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:14.057164 (+ 1060us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:14.057203 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:14.060386 (+ 3183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:14.064680 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:14.064696 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:14.064715 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:14.065537 (+ 822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:14.066219 (+ 682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:14.066223 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:14.066226 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:14.066493 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:14.067377 (+ 884us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:14.067384 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:14.067791 (+ 407us) client_negotiation.cc:769] Sending connection context
0808 02:41:14.068174 (+ 383us) client_negotiation.cc:240] Negotiation successful
0808 02:41:14.068826 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":407,"threads_started":1}
I20260808 02:41:14.072247 23686 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46353
I20260808 02:41:14.072713 23686 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:14.073606 23686 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:14.075632 23316 ts_manager.cc:194] Registered new tserver with Master: 8f669ceb0f4348589974a3ed1e7d1c3b (127.10.20.66:44119)
I20260808 02:41:14.076999 23316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:34251
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:41:14.142880 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46353
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:14.247175 23537 heartbeater.cc:503] Master 127.10.20.126:46353 was elected leader, sending a full tablet report...
W20260808 02:41:14.573947 23693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:14.574313 23693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:14.574487 23693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:14.583364 23693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:14.583546 23693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:14.583753 23693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:41:14.595544 23693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.20.84:58459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:46353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:14.597101 23693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:14.599211 23693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:14.616161 23698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:14.616240 23701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:14.616263 23699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:14.617700 23693 server_base.cc:1034] running on GCE node
I20260808 02:41:14.618623 23693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:14.620082 23693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:14.621448 23693 hybrid_clock.cc:648] HybridClock initialized: now 1786156874621344 us; error 69 us; skew 500 ppm
I20260808 02:41:14.622030 23693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:14 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156874, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:14.626637 23693 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:41:14.628826 23693 webserver.cc:460] Webserver started at http://127.10.20.67:37773/ using document root <none> and password file <none>
I20260808 02:41:14.629739 23693 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:14.629933 23693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:14.630329 23693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 02:41:14 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156874, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:14.654603 23693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "8c03c05a0f3a4d3ab4681db47047149a"
format_stamp: "Formatted at 2026-08-08 02:41:14 on dist-test-slave-8tdl"
server_key: "313b56e55f853466b9e710b90eda563f"
server_key_iv: "a2c2b232e2f1920e5ca49ca180e79225"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:14.655973 23693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "8c03c05a0f3a4d3ab4681db47047149a"
format_stamp: "Formatted at 2026-08-08 02:41:14 on dist-test-slave-8tdl"
server_key: "313b56e55f853466b9e710b90eda563f"
server_key_iv: "a2c2b232e2f1920e5ca49ca180e79225"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:14.666347 23693 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s
I20260808 02:41:14.687637 23708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:14.690107 23693 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260808 02:41:14.690400 23693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "8c03c05a0f3a4d3ab4681db47047149a"
format_stamp: "Formatted at 2026-08-08 02:41:14 on dist-test-slave-8tdl"
server_key: "313b56e55f853466b9e710b90eda563f"
server_key_iv: "a2c2b232e2f1920e5ca49ca180e79225"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:14.690726 23693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:14.713452 23693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:14.719735 23693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:14.720070 23693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:14.721508 23693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:14.723623 23693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:14.723784 23693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:14.723922 23693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:14.724010 23693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:14.768811 23693 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:35545
I20260808 02:41:14.769256 23823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:35545 every 8 connection(s)
I20260808 02:41:14.770826 23693 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:41:14.775851 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 23693
I20260808 02:41:14.776191 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:41:14.776960 10321 external_mini_cluster.cc:1428] Setting key 1b117ccf75af1e4c93cd3a9324f07c15
Aug 08 02:41:14 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156874, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:14.800048 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:14.776145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44169 (local address 127.10.20.126:46353)
0808 02:41:14.776836 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:14.776843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:14.778299 (+ 1456us) server_negotiation.cc:407] Connection header received
0808 02:41:14.780377 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:14.780384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:14.780504 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:14.780641 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:14.782606 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.783655 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.785922 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.786880 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.787114 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:14.792551 (+ 5437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:14.792560 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:14.792565 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:14.792624 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:14.796040 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.797103 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.797111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.797114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.797310 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.797898 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.797904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.797908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.798241 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:14.798422 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:14.799345 (+ 923us) server_negotiation.cc:299] Negotiation successful
0808 02:41:14.799639 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":349,"threads_started":1}
I20260808 02:41:14.801252 23827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:14.776853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46353 (local address 127.10.20.67:44169)
0808 02:41:14.778085 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:14.778145 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:14.780063 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:14.781163 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:14.781173 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:14.781704 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:14.782388 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:14.782409 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.783879 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.783884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:14.785560 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:14.785578 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.787318 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.787327 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:14.787606 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:14.788605 (+ 999us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:14.788649 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:14.791940 (+ 3291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:14.796234 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:14.796250 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:14.796269 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:14.796959 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:14.797448 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:14.797453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:14.797455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:14.797734 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:14.798428 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:14.798440 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:14.798927 (+ 487us) client_negotiation.cc:769] Sending connection context
0808 02:41:14.799253 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 02:41:14.799865 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":494,"threads_started":1}
I20260808 02:41:14.803560 23824 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46353
I20260808 02:41:14.804057 23824 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:14.804951 23824 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:14.807086 23316 ts_manager.cc:194] Registered new tserver with Master: 8c03c05a0f3a4d3ab4681db47047149a (127.10.20.67:35545)
I20260808 02:41:14.808288 23316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:44169
I20260808 02:41:14.810063 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:41:14.812348 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 23397
Aug 08 02:41:14 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:41:14.834534 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:14.813704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51772 (local address 127.10.20.65:33521)
0808 02:41:14.814710 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:14.814723 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:14.814772 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:41:14.814887 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:14.814895 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:14.815151 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:14.815381 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:14.817214 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.818451 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.820502 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.821266 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.821465 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:14.827685 (+ 6220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:14.827704 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:14.827721 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:14.827767 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:14.831174 (+ 3407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.832065 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.832074 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.832076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.832228 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.832658 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.832664 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.832667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.833061 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:14.833433 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:14.833799 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 02:41:14.834151 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":578,"threads_started":1}
I20260808 02:41:14.836242 23527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:14.933468 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 23397
I20260808 02:41:14.954640 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 23545
Aug 08 02:41:14 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:41:14.977845 23832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:14.956244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54100 (local address 127.10.20.66:44119)
0808 02:41:14.957094 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:14.957101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:14.957156 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:41:14.957223 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:14.957230 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:14.957454 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:14.957705 (+ 251us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:14.959191 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.960286 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.962241 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:14.963053 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:14.963236 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:14.968809 (+ 5573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:14.968828 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:14.968848 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:14.968917 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:14.973276 (+ 4359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.974608 (+ 1332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.974619 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.974621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.974934 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:14.975812 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:14.975817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:14.975819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:14.976273 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:14.976556 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:14.977124 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 02:41:14.977442 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":487,"threads_started":1}
I20260808 02:41:14.979928 23681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:15.077678 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 23545
I20260808 02:41:15.101074 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 23693
Aug 08 02:41:15 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:41:15.125355 23834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:15.103401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60232 (local address 127.10.20.67:35545)
0808 02:41:15.104252 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:15.104260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:15.104295 (+ 35us) server_negotiation.cc:407] Connection header received
0808 02:41:15.104362 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:15.104369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:15.104618 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:15.104846 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:15.106475 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:15.107665 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:15.109190 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:15.109874 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:15.110053 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:15.116332 (+ 6279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:15.116354 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:15.116373 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:15.116438 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:15.121312 (+ 4874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:15.122331 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:15.122340 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:15.122342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:15.122517 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:15.123089 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:15.123094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:15.123097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:15.123788 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:15.124284 (+ 496us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:15.124579 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 02:41:15.124931 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":533,"threads_started":1}
I20260808 02:41:15.127562 23818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:15.230643 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 23693
I20260808 02:41:15.253659 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 23281
I20260808 02:41:15.255545 23347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:15.380319 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 23281
I20260808 02:41:15.409952 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46353
--webserver_interface=127.10.20.126
--webserver_port=37839
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:46353
--ranger_config_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:15.808017 23837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:15.808358 23837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:15.808455 23837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:15.816478 23837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:15.816632 23837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:15.816679 23837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:15.816731 23837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:15.816781 23837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:15.827555 23837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:46353
--ranger_config_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:46353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=37839
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:15.828902 23837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:15.830303 23837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:15.845518 23843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:15.845597 23842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:15.845979 23837 server_base.cc:1034] running on GCE node
W20260808 02:41:15.845338 23845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:15.847491 23837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:15.849315 23837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:15.850770 23837 hybrid_clock.cc:648] HybridClock initialized: now 1786156875850635 us; error 83 us; skew 500 ppm
I20260808 02:41:15.851257 23837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:15 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156875, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:15.861768 23837 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:15.863863 23837 webserver.cc:460] Webserver started at http://127.10.20.126:37839/ using document root <none> and password file <none>
I20260808 02:41:15.864662 23837 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:15.864801 23837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:41:15 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156875, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:15.954202 23837 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:41:15.958145 23853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:15.960085 23837 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 02:41:15.960345 23837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "b8a76b0890d14954a1085b9a42b80ec2"
format_stamp: "Formatted at 2026-08-08 02:41:10 on dist-test-slave-8tdl"
server_key: "c774fc1e2d41e75dd6526866e1f6853c"
server_key_iv: "71b3f359737fdcfbdfc60bd1af46f54d"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:15.961447 23837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:15.980705 23837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:15.986379 23837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:15.986850 23837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:16.015812 23837 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:46353
I20260808 02:41:16.015852 23905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:46353 every 8 connection(s)
I20260808 02:41:16.018762 23837 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:16.020771 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 23837
I20260808 02:41:16.021970 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:33521
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:46353
--webserver_port=33989
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:16.031760 23906 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:41:16.037660 23906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Bootstrap starting.
I20260808 02:41:16.060954 23906 log.cc:824] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:16.073818 23906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:41:16.074631 23906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Bootstrap complete.
I20260808 02:41:16.085700 23906 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:16.087018 23906 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a76b0890d14954a1085b9a42b80ec2, State: Initialized, Role: FOLLOWER
I20260808 02:41:16.087961 23906 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:16.088296 23906 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:16.088438 23906 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:16.088666 23906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:41:16.093904 23906 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:16.094981 23906 leader_election.cc:302] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a76b0890d14954a1085b9a42b80ec2; no voters:
I20260808 02:41:16.096031 23906 leader_election.cc:288] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:41:16.096241 23910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:41:16.097918 23910 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [term 2 LEADER]: Becoming Leader. State: Replica: b8a76b0890d14954a1085b9a42b80ec2, State: Running, Role: LEADER
I20260808 02:41:16.099212 23906 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:16.098799 23910 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } }
I20260808 02:41:16.102415 23911 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b8a76b0890d14954a1085b9a42b80ec2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } } }
I20260808 02:41:16.102768 23911 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:16.101999 23912 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a76b0890d14954a1085b9a42b80ec2. Latest consensus state: current_term: 2 leader_uuid: "b8a76b0890d14954a1085b9a42b80ec2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a76b0890d14954a1085b9a42b80ec2" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 46353 } } }
I20260808 02:41:16.103425 23912 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:16.115736 23916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:16.122903 23916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:16.124331 23906 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 02:41:16.124919 23916 catalog_manager.cc:1259] Loaded cluster ID: 5a820b69387c4dd7a189ea62b48001fc
I20260808 02:41:16.125339 23916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:16.133635 23916 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:16.144897 23916 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Loaded TSK: 0
I20260808 02:41:16.147825 23916 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:41:16.549903 23908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:16.550478 23908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:16.550733 23908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:16.563365 23908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:16.563633 23908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:16.563896 23908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:41:16.580809 23908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:33521
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=33989
--tserver_master_addrs=127.10.20.126:46353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:16.583122 23908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:16.585156 23908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:16.608108 23944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:16.609517 23943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:16.619077 23908 server_base.cc:1034] running on GCE node
W20260808 02:41:16.620684 23946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:16.621755 23908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:16.623328 23908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:16.624687 23908 hybrid_clock.cc:648] HybridClock initialized: now 1786156876624622 us; error 58 us; skew 500 ppm
I20260808 02:41:16.625211 23908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:16 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:16.629948 23908 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:41:16.640925 23908 webserver.cc:460] Webserver started at http://127.10.20.65:33989/ using document root <none> and password file <none>
I20260808 02:41:16.641861 23908 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:16.642083 23908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:41:16 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:16.693079 23908 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.008s sys 0.000s
I20260808 02:41:16.711485 23954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:16.713879 23908 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.010s sys 0.000s
I20260808 02:41:16.714257 23908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "5fcc7ad8628e44bea74a3f6bd758bab7"
format_stamp: "Formatted at 2026-08-08 02:41:12 on dist-test-slave-8tdl"
server_key: "ad6aafe55771349a5680af7d287c1bbc"
server_key_iv: "d17a7128fc2576e3a298ef098f458fed"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:16.716174 23908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:16.766713 23908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:16.773378 23908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:16.773804 23908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:16.781466 23908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:16.802567 23908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:16.802875 23908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 02:41:16.803108 23908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:16.803279 23908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:16.862398 23908 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:33521
I20260808 02:41:16.862480 24071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:33521 every 8 connection(s)
I20260808 02:41:16.865283 23908 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:41:16.872069 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 23908
I20260808 02:41:16.873013 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:44119
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:46353
--webserver_port=32797
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:41:16 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:16.928473 24075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:16.870789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46353 (local address 127.10.20.65:39169)
0808 02:41:16.892063 (+ 21274us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:16.892140 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:16.896859 (+ 4719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:16.901514 (+ 4655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:16.901529 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:16.902198 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:16.902994 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:16.903021 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:16.906500 (+ 3479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:16.906504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:16.907970 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:16.908004 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:16.909908 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:16.909917 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:16.910271 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:16.911225 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:16.911261 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:16.914730 (+ 3469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:16.921203 (+ 6473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:16.921215 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:16.921238 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:16.922204 (+ 966us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:16.923081 (+ 877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:16.923087 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:16.923092 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:16.923508 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:16.925037 (+ 1529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:16.925048 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:16.925595 (+ 547us) client_negotiation.cc:769] Sending connection context
0808 02:41:16.925983 (+ 388us) client_negotiation.cc:240] Negotiation successful
0808 02:41:16.926752 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20418,"thread_start_us":20199,"threads_started":1}
I20260808 02:41:16.932106 24074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:16.870666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:39169 (local address 127.10.20.126:46353)
0808 02:41:16.883124 (+ 12458us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:16.883155 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:16.892424 (+ 9269us) server_negotiation.cc:407] Connection header received
0808 02:41:16.898304 (+ 5880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:16.898368 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:16.899247 (+ 879us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:16.899758 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:16.903344 (+ 3586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:16.906220 (+ 2876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:16.908203 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:16.909540 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:16.909849 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:16.915253 (+ 5404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:16.915269 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:16.915294 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:16.915362 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:16.920936 (+ 5574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:16.922529 (+ 1593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:16.922544 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:16.922554 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:16.922881 (+ 327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:16.923760 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:16.923767 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:16.923771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:16.924652 (+ 881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:16.924902 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:16.929736 (+ 4834us) server_negotiation.cc:299] Negotiation successful
0808 02:41:16.930322 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11975,"thread_start_us":12315,"threads_started":1}
I20260808 02:41:16.937011 24072 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46353
I20260808 02:41:16.937489 24072 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:16.938856 24072 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
W20260808 02:41:16.943822 24072 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:46353 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:41:16.944151 24072 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:16.944814 24072 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:16.947261 24072 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:16.947724 24072 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
W20260808 02:41:16.949389 24072 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:41:17.390883 24076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:17.391263 24076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:17.391426 24076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:17.403329 24076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:17.403538 24076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:17.403834 24076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:41:17.420507 24076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:44119
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=32797
--tserver_master_addrs=127.10.20.126:46353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:17.422361 24076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:17.424654 24076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:17.446120 24091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:17.446161 24090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:17.447080 24093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:17.447408 24076 server_base.cc:1034] running on GCE node
I20260808 02:41:17.448252 24076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:17.449791 24076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:17.451112 24076 hybrid_clock.cc:648] HybridClock initialized: now 1786156877451050 us; error 100 us; skew 500 ppm
I20260808 02:41:17.451535 24076 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:17 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:17.456240 24076 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:41:17.458552 24076 webserver.cc:460] Webserver started at http://127.10.20.66:32797/ using document root <none> and password file <none>
I20260808 02:41:17.459445 24076 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:17.459636 24076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:41:17 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:17.507962 24076 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.006s sys 0.000s
I20260808 02:41:17.517990 24104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:17.520710 24076 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.002s
I20260808 02:41:17.521076 24076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "8f669ceb0f4348589974a3ed1e7d1c3b"
format_stamp: "Formatted at 2026-08-08 02:41:13 on dist-test-slave-8tdl"
server_key: "2da92ad94cf66a65095dfcc80a39dfd2"
server_key_iv: "bb35bd6e2d168280e81a88836e8cbe96"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:17.523140 24076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:17.573105 24076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:17.578223 24076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:17.578578 24076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:17.579802 24076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:17.581811 24076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:17.581954 24076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:17.582120 24076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:17.582219 24076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 02:41:17 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786156877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:17.661671 24076 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:44119
I20260808 02:41:17.661736 24220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:44119 every 8 connection(s)
I20260808 02:41:17.663998 24076 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:41:17.669282 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24076
I20260808 02:41:17.670188 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.20.84:58459/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:35545
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:46353
--webserver_port=37773
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:41:17 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:17.731564 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:17.670948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:46903 (local address 127.10.20.126:46353)
0808 02:41:17.686844 (+ 15896us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:17.686852 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:17.698820 (+ 11968us) server_negotiation.cc:407] Connection header received
0808 02:41:17.703620 (+ 4800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:17.703631 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:17.703755 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:17.703847 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:17.707156 (+ 3309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:17.708439 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:17.711430 (+ 2991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:17.712168 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:17.712308 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:17.718727 (+ 6419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:17.718737 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:17.718743 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:17.718798 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:17.725432 (+ 6634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:17.726929 (+ 1497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:17.726935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:17.726939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:17.727127 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:17.727726 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:17.727731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:17.727735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:17.728119 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:17.728275 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:17.730912 (+ 2637us) server_negotiation.cc:299] Negotiation successful
0808 02:41:17.731183 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15684,"thread_start_us":15542,"threads_started":1}
I20260808 02:41:17.734515 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:17.670194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46353 (local address 127.10.20.66:46903)
0808 02:41:17.698385 (+ 28191us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:17.698512 (+ 127us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:17.702769 (+ 4257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:17.704718 (+ 1949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:17.704736 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:17.705565 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:17.706815 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:17.706863 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:17.708755 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:17.708761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:17.711145 (+ 2384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:17.711171 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:17.712774 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:17.712782 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:17.713154 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:17.714226 (+ 1072us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:17.714271 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:17.718246 (+ 3975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:17.725693 (+ 7447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:17.725706 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:17.725730 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:17.726619 (+ 889us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:17.727272 (+ 653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:17.727277 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:17.727281 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:17.727586 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:17.728353 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:17.728362 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:17.728924 (+ 562us) client_negotiation.cc:769] Sending connection context
0808 02:41:17.729249 (+ 325us) client_negotiation.cc:240] Negotiation successful
0808 02:41:17.729916 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27597,"thread_start_us":27191,"threads_started":1}
I20260808 02:41:17.736670 24221 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46353
I20260808 02:41:17.737035 24221 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:17.737987 24221 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:17.740525 23871 ts_manager.cc:194] Registered new tserver with Master: 8f669ceb0f4348589974a3ed1e7d1c3b (127.10.20.66:44119)
I20260808 02:41:17.742700 23871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:46903
I20260808 02:41:17.949617 24072 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:17.950212 24072 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:17.952102 23871 ts_manager.cc:194] Registered new tserver with Master: 5fcc7ad8628e44bea74a3f6bd758bab7 (127.10.20.65:33521)
I20260808 02:41:17.953310 23871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:39169
Aug 08 02:41:18 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
W20260808 02:41:18.201404 24225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:18.202039 24225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:18.202246 24225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:18.216383 24225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:18.216691 24225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:18.216933 24225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:41:18.235404 24225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.20.84:58459/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:35545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=37773
--tserver_master_addrs=127.10.20.126:46353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:18.237550 24225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:18.239576 24225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:18.276636 24232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:18.283355 24231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:18.284056 24225 server_base.cc:1034] running on GCE node
W20260808 02:41:18.284936 24235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:18.286119 24225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:18.293053 24225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:18.296600 24225 hybrid_clock.cc:648] HybridClock initialized: now 1786156878296477 us; error 111 us; skew 500 ppm
I20260808 02:41:18.297248 24225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:18 dist-test-slave-8tdl krb5kdc[22811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156878, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:18.302217 24225 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:41:18.306936 24225 webserver.cc:460] Webserver started at http://127.10.20.67:37773/ using document root <none> and password file <none>
I20260808 02:41:18.308066 24225 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:18.308274 24225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 02:41:18 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156878, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:18.335227 24225 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:41:18.343331 24242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:18.345510 24225 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.000s
I20260808 02:41:18.345729 24225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "8c03c05a0f3a4d3ab4681db47047149a"
format_stamp: "Formatted at 2026-08-08 02:41:14 on dist-test-slave-8tdl"
server_key: "313b56e55f853466b9e710b90eda563f"
server_key_iv: "a2c2b232e2f1920e5ca49ca180e79225"
server_key_version: "kuduclusterkey@0"
I20260808 02:41:18.347429 24225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:18.384775 24225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:18.391197 24225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:18.391574 24225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:18.393043 24225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:18.395254 24225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:18.395394 24225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:18.395576 24225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:18.395709 24225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:18.458572 24225 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:35545
I20260808 02:41:18.458868 24356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:35545 every 8 connection(s)
I20260808 02:41:18.460958 24225 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:41:18.471105 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24225
Aug 08 02:41:18 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156878, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:18.508905 24360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.470918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:59921 (local address 127.10.20.126:46353)
0808 02:41:18.475198 (+ 4280us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:18.475208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:18.485028 (+ 9820us) server_negotiation.cc:407] Connection header received
0808 02:41:18.487973 (+ 2945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:18.487978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:18.488094 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:18.488178 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:18.490735 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.492128 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.494939 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.495650 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.495754 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.500783 (+ 5029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:18.500791 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:18.500796 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:18.500860 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:18.504388 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:18.505549 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:18.505554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:18.505557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:18.505710 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:18.506362 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:18.506367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:18.506370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:18.506756 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:18.506903 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:18.508077 (+ 1174us) server_negotiation.cc:299] Negotiation successful
0808 02:41:18.508365 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4120,"thread_start_us":4272,"threads_started":1}
I20260808 02:41:18.512174 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.469957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:46353 (local address 127.10.20.67:59921)
0808 02:41:18.484693 (+ 14736us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:18.484881 (+ 188us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:18.487604 (+ 2723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:18.488882 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:18.488896 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:18.489538 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:18.490406 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.490432 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.492367 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.492373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.494646 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.494672 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.496163 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.496171 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.496482 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.497377 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:18.497409 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:18.500232 (+ 2823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:18.504612 (+ 4380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:18.504623 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:18.504647 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:18.505388 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:18.505877 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:18.505882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:18.505886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:18.506201 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:18.507011 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:18.507021 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:18.507548 (+ 527us) client_negotiation.cc:769] Sending connection context
0808 02:41:18.509668 (+ 2120us) client_negotiation.cc:240] Negotiation successful
0808 02:41:18.510505 (+ 837us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14387,"thread_start_us":14109,"threads_started":1}
I20260808 02:41:18.512406 24362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.472879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.10.20.126:46353)
0808 02:41:18.484122 (+ 11243us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:18.484128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:18.484170 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:41:18.484242 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:18.484247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:18.484362 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:18.484493 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:18.487297 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.488523 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.490582 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.491659 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.491807 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.495969 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:18.495977 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:18.495982 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:18.496034 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:18.500928 (+ 4894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:18.504349 (+ 3421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:18.504355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:18.504359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:18.504546 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:18.505063 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:18.505068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:18.505071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:18.505433 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:18.511539 (+ 6106us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:18.511708 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 02:41:18.512064 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11094,"thread_start_us":10910,"threads_started":1}
I20260808 02:41:18.514086 24357 heartbeater.cc:347] Connected to a master server at 127.10.20.126:46353
I20260808 02:41:18.514475 24357 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:18.515672 24357 heartbeater.cc:511] Master 127.10.20.126:46353 requested a full tablet report, sending...
I20260808 02:41:18.517565 23870 ts_manager.cc:194] Registered new tserver with Master: 8c03c05a0f3a4d3ab4681db47047149a (127.10.20.67:35545)
I20260808 02:41:18.518822 23870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:59921
I20260808 02:41:18.530290 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 02:41:18 dist-test-slave-8tdl krb5kdc[22811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for HTTP/127.10.20.84@KRBTEST.COM
I20260808 02:41:18.581348 24362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.554941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52596 (local address 127.10.20.126:46353)
0808 02:41:18.555171 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:18.555179 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:18.561445 (+ 6266us) server_negotiation.cc:407] Connection header received
0808 02:41:18.561624 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:18.561630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:18.561727 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:18.561845 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:18.564212 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.565558 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.568150 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.568934 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.569052 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.573144 (+ 4092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:18.573153 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:18.573157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:18.573212 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:18.577572 (+ 4360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:18.578700 (+ 1128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:18.578707 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:18.578711 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:18.578903 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:18.579438 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:18.579444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:18.579447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:18.579836 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:18.580093 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:18.580705 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 02:41:18.580978 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:41:18.589479 23870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52596:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:41:18.602102 23870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:41:18.701253 24374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.656821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:35545 (local address 127.0.0.1:60246)
0808 02:41:18.676626 (+ 19805us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:18.676700 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:18.676913 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:18.679030 (+ 2117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:18.679041 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:18.679088 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:18.679650 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.679668 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.682052 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.682095 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.685392 (+ 3297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.685422 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.698972 (+ 13550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.698984 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.699369 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.699462 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 02:41:18.700016 (+ 554us) client_negotiation.cc:240] Negotiation successful
0808 02:41:18.700512 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19457,"thread_start_us":20436,"threads_started":1}
I20260808 02:41:18.704406 24376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.657758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60246 (local address 127.10.20.67:35545)
0808 02:41:18.677683 (+ 19925us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:18.677694 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:18.677730 (+ 36us) server_negotiation.cc:407] Connection header received
0808 02:41:18.677831 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:18.677839 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:18.678117 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:18.678366 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:18.679923 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.681863 (+ 1940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.687327 (+ 5464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.689084 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.689253 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.689625 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:18.703406 (+ 13781us) server_negotiation.cc:299] Negotiation successful
0808 02:41:18.703709 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19715,"thread_start_us":20957,"threads_started":1}
I20260808 02:41:18.710119 24290 tablet_service.cc:1467] Processing CreateTablet for tablet 89491573c0304120a047c0de2eb3ff02 (DEFAULT_TABLE table=test-table [id=b0bc33bd146a4b148c9dfea0fa47295e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:18.712083 24290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89491573c0304120a047c0de2eb3ff02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:18.720996 24374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.685776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51778)
0808 02:41:18.706742 (+ 20966us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:18.706767 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:18.706917 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:18.708521 (+ 1604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:18.708528 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:18.708563 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:18.708774 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.708786 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.711149 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.711157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.713347 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.713384 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.719922 (+ 6538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.719931 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.720195 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.720244 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 02:41:18.720358 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 02:41:18.720582 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20833,"thread_start_us":16487,"threads_started":1}
I20260808 02:41:18.722595 24380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.686124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51778 (local address 127.10.20.65:33521)
0808 02:41:18.699268 (+ 13144us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:18.699280 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:18.706890 (+ 7610us) server_negotiation.cc:407] Connection header received
0808 02:41:18.707235 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:18.707246 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:18.707547 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:18.707976 (+ 429us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:18.709029 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.710918 (+ 1889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.713684 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.716885 (+ 3201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.721491 (+ 4606us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.721818 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:18.721919 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 02:41:18.722189 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12922,"thread_start_us":12737,"threads_started":1}
I20260808 02:41:18.727782 24005 tablet_service.cc:1467] Processing CreateTablet for tablet 89491573c0304120a047c0de2eb3ff02 (DEFAULT_TABLE table=test-table [id=b0bc33bd146a4b148c9dfea0fa47295e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:18.730171 24005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89491573c0304120a047c0de2eb3ff02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:18.735932 24379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.661567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:44119 (local address 127.0.0.1:54116)
0808 02:41:18.702742 (+ 41175us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:18.702775 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:18.703070 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:18.726010 (+ 22940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:18.726017 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:18.726052 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:18.726435 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.726461 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.728805 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.728812 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.730903 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:18.730921 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.734975 (+ 4054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.734983 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:18.735204 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.735241 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:41:18.735352 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:41:18.735536 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40960,"thread_start_us":70080,"threads_started":1}
I20260808 02:41:18.740890 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:18.662336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54116 (local address 127.10.20.66:44119)
0808 02:41:18.725295 (+ 62959us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:18.725305 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:18.725339 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:41:18.725453 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:18.725461 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:18.725738 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:18.726006 (+ 268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:18.726875 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.728629 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.733130 (+ 4501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:18.734640 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:18.734888 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:18.735158 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:18.740186 (+ 5028us) server_negotiation.cc:299] Negotiation successful
0808 02:41:18.740417 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62761,"thread_start_us":63868,"threads_started":1}
I20260808 02:41:18.745968 24154 tablet_service.cc:1467] Processing CreateTablet for tablet 89491573c0304120a047c0de2eb3ff02 (DEFAULT_TABLE table=test-table [id=b0bc33bd146a4b148c9dfea0fa47295e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:18.749496 24221 heartbeater.cc:503] Master 127.10.20.126:46353 was elected leader, sending a full tablet report...
I20260808 02:41:18.750205 24154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89491573c0304120a047c0de2eb3ff02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:18.761457 24381 tablet_bootstrap.cc:492] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Bootstrap starting.
I20260808 02:41:18.765728 24381 tablet_bootstrap.cc:654] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:18.769718 24381 log.cc:824] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:18.779701 24382 tablet_bootstrap.cc:492] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Bootstrap starting.
I20260808 02:41:18.779856 24381 tablet_bootstrap.cc:492] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: No bootstrap required, opened a new log
I20260808 02:41:18.780282 24381 ts_tablet_manager.cc:1397] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.005s
I20260808 02:41:18.783514 24384 tablet_bootstrap.cc:492] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Bootstrap starting.
I20260808 02:41:18.789203 24382 tablet_bootstrap.cc:654] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:18.792964 24381 raft_consensus.cc:348] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:18.793592 24381 raft_consensus.cc:374] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:18.793723 24381 raft_consensus.cc:729] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fcc7ad8628e44bea74a3f6bd758bab7, State: Initialized, Role: FOLLOWER
I20260808 02:41:18.794716 24381 consensus_queue.cc:260] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:18.797194 24382 log.cc:824] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:18.798791 24384 tablet_bootstrap.cc:654] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:18.802178 24384 log.cc:824] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:18.803910 24381 ts_tablet_manager.cc:1428] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Time spent starting tablet: real 0.023s user 0.012s sys 0.011s
I20260808 02:41:18.804392 24072 heartbeater.cc:503] Master 127.10.20.126:46353 was elected leader, sending a full tablet report...
I20260808 02:41:18.812911 24384 tablet_bootstrap.cc:492] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: No bootstrap required, opened a new log
I20260808 02:41:18.814087 24384 ts_tablet_manager.cc:1397] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Time spent bootstrapping tablet: real 0.031s user 0.012s sys 0.002s
I20260808 02:41:18.817252 24382 tablet_bootstrap.cc:492] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: No bootstrap required, opened a new log
I20260808 02:41:18.817626 24382 ts_tablet_manager.cc:1397] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.006s
I20260808 02:41:18.831784 24382 raft_consensus.cc:348] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:18.832473 24382 raft_consensus.cc:374] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:18.832605 24382 raft_consensus.cc:729] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c03c05a0f3a4d3ab4681db47047149a, State: Initialized, Role: FOLLOWER
I20260808 02:41:18.832605 24384 raft_consensus.cc:348] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:18.833173 24384 raft_consensus.cc:374] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:18.833478 24382 consensus_queue.cc:260] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:18.833532 24384 raft_consensus.cc:729] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f669ceb0f4348589974a3ed1e7d1c3b, State: Initialized, Role: FOLLOWER
I20260808 02:41:18.834718 24384 consensus_queue.cc:260] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:18.843245 24384 ts_tablet_manager.cc:1428] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Time spent starting tablet: real 0.029s user 0.011s sys 0.009s
I20260808 02:41:18.846293 24357 heartbeater.cc:503] Master 127.10.20.126:46353 was elected leader, sending a full tablet report...
I20260808 02:41:18.851293 24382 ts_tablet_manager.cc:1428] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Time spent starting tablet: real 0.034s user 0.021s sys 0.005s
W20260808 02:41:18.871616 24073 tablet.cc:2369] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:41:18.920620 24222 tablet.cc:2369] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:41:18.971030 24358 tablet.cc:2369] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:19.154963 24388 raft_consensus.cc:482] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:41:19.155339 24388 raft_consensus.cc:504] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:19.157294 24388 leader_election.cc:288] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f669ceb0f4348589974a3ed1e7d1c3b (127.10.20.66:44119), 5fcc7ad8628e44bea74a3f6bd758bab7 (127.10.20.65:33521)
I20260808 02:41:19.167014 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.157897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:34121 (local address 127.10.20.66:44119)
0808 02:41:19.158511 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:19.158516 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:19.158907 (+ 391us) server_negotiation.cc:407] Connection header received
0808 02:41:19.159164 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:19.159171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:19.159271 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:19.159380 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:19.160177 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.161137 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.163976 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.165688 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.165863 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.165997 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:19.166513 (+ 516us) server_negotiation.cc:299] Negotiation successful
0808 02:41:19.166647 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339}
I20260808 02:41:19.167129 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.157653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:44119 (local address 127.10.20.67:34121)
0808 02:41:19.158733 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.158762 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:19.158969 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:19.159440 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:19.159445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:19.159480 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:19.159978 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:19.159994 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.161378 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.161385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:19.163663 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:19.163681 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.165957 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.165965 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:19.166211 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.166282 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 02:41:19.166471 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 02:41:19.166641 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"thread_start_us":1105,"threads_started":1}
I20260808 02:41:19.167927 24380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.157890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:38199 (local address 127.10.20.65:33521)
0808 02:41:19.158189 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:19.158200 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:19.159327 (+ 1127us) server_negotiation.cc:407] Connection header received
0808 02:41:19.159551 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:19.159557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:19.159641 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:19.159775 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:19.160632 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.161795 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.165360 (+ 3565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.166596 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.166811 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.166909 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:19.167571 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 02:41:19.167682 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:41:19.167891 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.157746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.10.20.67:38199)
0808 02:41:19.159164 (+ 1418us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.159183 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:19.159344 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:19.159802 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:19.159810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:19.159847 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:19.160430 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:19.160447 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.162255 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.162262 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:19.164786 (+ 2524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:19.164816 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.166940 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.166948 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:19.167182 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.167220 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:41:19.167376 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 02:41:19.167549 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1270,"thread_start_us":553,"threads_started":1}
I20260808 02:41:19.168462 24174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89491573c0304120a047c0de2eb3ff02" candidate_uuid: "8c03c05a0f3a4d3ab4681db47047149a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" is_pre_election: true
I20260808 02:41:19.169098 24174 raft_consensus.cc:2454] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c03c05a0f3a4d3ab4681db47047149a in term 0.
I20260808 02:41:19.169216 24026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89491573c0304120a047c0de2eb3ff02" candidate_uuid: "8c03c05a0f3a4d3ab4681db47047149a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" is_pre_election: true
I20260808 02:41:19.169824 24026 raft_consensus.cc:2454] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c03c05a0f3a4d3ab4681db47047149a in term 0.
I20260808 02:41:19.170176 24245 leader_election.cc:302] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c03c05a0f3a4d3ab4681db47047149a, 8f669ceb0f4348589974a3ed1e7d1c3b; no voters:
I20260808 02:41:19.170665 24388 raft_consensus.cc:2781] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:41:19.170888 24388 raft_consensus.cc:482] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:41:19.171026 24388 raft_consensus.cc:3037] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:19.176450 24388 raft_consensus.cc:504] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:19.177278 24388 leader_election.cc:288] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [CANDIDATE]: Term 1 election: Requested vote from peers 8f669ceb0f4348589974a3ed1e7d1c3b (127.10.20.66:44119), 5fcc7ad8628e44bea74a3f6bd758bab7 (127.10.20.65:33521)
I20260808 02:41:19.177937 24026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89491573c0304120a047c0de2eb3ff02" candidate_uuid: "8c03c05a0f3a4d3ab4681db47047149a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7"
I20260808 02:41:19.177915 24174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89491573c0304120a047c0de2eb3ff02" candidate_uuid: "8c03c05a0f3a4d3ab4681db47047149a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b"
I20260808 02:41:19.178210 24026 raft_consensus.cc:3037] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:19.178228 24174 raft_consensus.cc:3037] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:19.180787 24026 raft_consensus.cc:2454] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c03c05a0f3a4d3ab4681db47047149a in term 1.
I20260808 02:41:19.180944 24174 raft_consensus.cc:2454] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c03c05a0f3a4d3ab4681db47047149a in term 1.
I20260808 02:41:19.181393 24244 leader_election.cc:302] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fcc7ad8628e44bea74a3f6bd758bab7, 8c03c05a0f3a4d3ab4681db47047149a; no voters:
I20260808 02:41:19.181797 24388 raft_consensus.cc:2781] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:19.182473 24388 raft_consensus.cc:686] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 1 LEADER]: Becoming Leader. State: Replica: 8c03c05a0f3a4d3ab4681db47047149a, State: Running, Role: LEADER
I20260808 02:41:19.183104 24388 consensus_queue.cc:237] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } }
I20260808 02:41:19.189365 23871 catalog_manager.cc:5495] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c03c05a0f3a4d3ab4681db47047149a (127.10.20.67). New cstate: current_term: 1 leader_uuid: "8c03c05a0f3a4d3ab4681db47047149a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c03c05a0f3a4d3ab4681db47047149a" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 } health_report { overall_health: UNKNOWN } } }
I20260808 02:41:19.252543 24404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.245634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60254 (local address 127.10.20.67:35545)
0808 02:41:19.246258 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:19.246264 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:19.246400 (+ 136us) server_negotiation.cc:407] Connection header received
0808 02:41:19.246726 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:19.246736 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:19.246836 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:19.247000 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:41:19.247503 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.248494 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.250031 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.250440 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.250629 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.251240 (+ 611us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:41:19.251870 (+ 630us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:41:19.252045 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:19.252158 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 02:41:19.252248 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":321,"threads_started":1}
I20260808 02:41:19.263620 24026 raft_consensus.cc:1261] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 1 FOLLOWER]: Refusing update from remote peer 8c03c05a0f3a4d3ab4681db47047149a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:19.263620 24174 raft_consensus.cc:1261] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 1 FOLLOWER]: Refusing update from remote peer 8c03c05a0f3a4d3ab4681db47047149a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:19.264756 24399 consensus_queue.cc:1035] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fcc7ad8628e44bea74a3f6bd758bab7" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 33521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:19.265187 24388 consensus_queue.cc:1035] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f669ceb0f4348589974a3ed1e7d1c3b" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:19.279076 24406 mvcc.cc:205] Tried to move back new op lower bound from 7316098577451085824 to 7316098577138511872. Current Snapshot: MvccSnapshot[applied={T|T < 7316098577451085824}]
I20260808 02:41:19.299903 23870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:19.300392 23870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:19.305361 23870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8a76b0890d14954a1085b9a42b80ec2: Sending DeleteTablet for 3 replicas of tablet 89491573c0304120a047c0de2eb3ff02
I20260808 02:41:19.306901 24154 tablet_service.cc:1514] Processing DeleteTablet for tablet 89491573c0304120a047c0de2eb3ff02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:19 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:54116
I20260808 02:41:19.306901 24005 tablet_service.cc:1514] Processing DeleteTablet for tablet 89491573c0304120a047c0de2eb3ff02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:19 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:51778
I20260808 02:41:19.306946 24290 tablet_service.cc:1514] Processing DeleteTablet for tablet 89491573c0304120a047c0de2eb3ff02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:19 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:60246
I20260808 02:41:19.310771 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 23908
I20260808 02:41:19.324616 24416 tablet_replica.cc:330] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: stopping tablet replica
I20260808 02:41:19.328060 24416 raft_consensus.cc:2229] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:19.329018 24416 raft_consensus.cc:2258] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:19.331202 24415 tablet_replica.cc:330] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: stopping tablet replica
I20260808 02:41:19.333818 24416 ts_tablet_manager.cc:1905] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:19.331732 24415 raft_consensus.cc:2229] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:19.335290 24415 raft_consensus.cc:2258] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:19.338277 24415 ts_tablet_manager.cc:1905] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:19.343264 24417 tablet_replica.cc:330] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: stopping tablet replica
I20260808 02:41:19.343747 24416 ts_tablet_manager.cc:1918] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:19.343807 24417 raft_consensus.cc:2229] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:41:19.344092 24416 log.cc:1196] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/89491573c0304120a047c0de2eb3ff02
I20260808 02:41:19.344678 24417 raft_consensus.cc:2258] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:19.344897 24416 ts_tablet_manager.cc:1939] T 89491573c0304120a047c0de2eb3ff02 P 8f669ceb0f4348589974a3ed1e7d1c3b: Deleting consensus metadata
I20260808 02:41:19.347126 24417 ts_tablet_manager.cc:1905] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:19.347275 23856 catalog_manager.cc:4841] TS 8f669ceb0f4348589974a3ed1e7d1c3b (127.10.20.66:44119): tablet 89491573c0304120a047c0de2eb3ff02 (table test-table [id=b0bc33bd146a4b148c9dfea0fa47295e]) successfully deleted
I20260808 02:41:19.349882 24380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.312346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51780 (local address 127.10.20.65:33521)
0808 02:41:19.312615 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:19.312625 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:19.323429 (+ 10804us) server_negotiation.cc:407] Connection header received
0808 02:41:19.323761 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:19.323770 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:19.323905 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:19.324056 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:19.327419 (+ 3363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.328997 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.331880 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.332565 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.332718 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.338845 (+ 6127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:19.338865 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:19.338902 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:19.338980 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:19.344770 (+ 5790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:19.345914 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:19.345925 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:19.345928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:19.346128 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:19.346670 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:19.346675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:19.346678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:19.347204 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:19.348812 (+ 1608us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:19.349111 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 02:41:19.349428 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:41:19.350790 24067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:19.356118 24417 ts_tablet_manager.cc:1918] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:19.356355 24417 log.cc:1196] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/89491573c0304120a047c0de2eb3ff02
I20260808 02:41:19.356942 24417 ts_tablet_manager.cc:1939] T 89491573c0304120a047c0de2eb3ff02 P 8c03c05a0f3a4d3ab4681db47047149a: Deleting consensus metadata
I20260808 02:41:19.359215 23854 catalog_manager.cc:4841] TS 8c03c05a0f3a4d3ab4681db47047149a (127.10.20.67:35545): tablet 89491573c0304120a047c0de2eb3ff02 (table test-table [id=b0bc33bd146a4b148c9dfea0fa47295e]) successfully deleted
I20260808 02:41:19.450917 24415 ts_tablet_manager.cc:1918] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:19.451207 24415 log.cc:1196] T 89491573c0304120a047c0de2eb3ff02 P 5fcc7ad8628e44bea74a3f6bd758bab7: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/89491573c0304120a047c0de2eb3ff02
I20260808 02:41:19.451663 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 23908
I20260808 02:41:19.476243 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24076
W20260808 02:41:19.476258 23855 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:33521 (error 108)
I20260808 02:41:19.497310 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.481854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51796)
0808 02:41:19.496853 (+ 14999us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.497050 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14821,"thread_start_us":14656,"threads_started":1}
W20260808 02:41:19.497684 23855 catalog_manager.cc:4584] TS 5fcc7ad8628e44bea74a3f6bd758bab7 (127.10.20.65:33521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 89491573c0304120a047c0de2eb3ff02: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
I20260808 02:41:19.500622 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.477779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54126 (local address 127.10.20.66:44119)
0808 02:41:19.477988 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:19.477995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:19.478146 (+ 151us) server_negotiation.cc:407] Connection header received
0808 02:41:19.478388 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:19.478395 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:19.478515 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:19.478627 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:19.481415 (+ 2788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.483256 (+ 1841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.484811 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.485790 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.485947 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.490924 (+ 4977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:19.490952 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:19.490980 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:19.491055 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:19.496650 (+ 5595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:19.497735 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:19.497744 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:19.497746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:19.497959 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:19.498529 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:19.498535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:19.498539 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:19.499138 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:19.499519 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:19.499942 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 02:41:19.500203 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:41:19.501557 24215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:19.551818 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.551210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51808)
0808 02:41:19.551478 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.551634 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260808 02:41:19.553356 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.552832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51814)
0808 02:41:19.553041 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.553149 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 02:41:19.605883 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24076
I20260808 02:41:19.614899 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.613881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51824)
0808 02:41:19.614433 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.614602 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372}
I20260808 02:41:19.616547 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.615892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51838)
0808 02:41:19.616178 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.616288 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260808 02:41:19.630564 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24225
I20260808 02:41:19.650064 24404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.631607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60266 (local address 127.10.20.67:35545)
0808 02:41:19.631815 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:19.631820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:19.631906 (+ 86us) server_negotiation.cc:407] Connection header received
0808 02:41:19.632104 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:19.632108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:19.632184 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:19.632272 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:19.634380 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.635648 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.637772 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:19.638302 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:19.638429 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:19.642380 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:19.642410 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:19.642427 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:19.642470 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:19.646610 (+ 4140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:19.647651 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:19.647661 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:19.647665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:19.647842 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:19.648247 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:19.648252 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:19.648255 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:19.648673 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:19.649034 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:19.649340 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 02:41:19.649641 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:41:19.650879 24352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:19.697772 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.697036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51852)
0808 02:41:19.697450 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.697568 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260808 02:41:19.699270 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.698802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51854)
0808 02:41:19.699021 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.699112 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 02:41:19.790292 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24225
I20260808 02:41:19.814062 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 23837
I20260808 02:41:19.815640 23901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:19.942301 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:19.941306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:33521 (local address 127.0.0.1:51870)
0808 02:41:19.941788 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:19.941899 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:33521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213}
I20260808 02:41:19.942641 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 23837
I20260808 02:41:19.970561 10321 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 02:41:20.319139 10321 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 02:41:20.319365 10321 mini_ranger.cc:66] Stopping Ranger...
I20260808 02:41:20.669070 10321 mini_ranger.cc:68] Stopped Ranger
2026-08-08 02:41:20.669 UTC [22843] LOG: received smart shutdown request
2026-08-08 02:41:20.675 UTC [22843] LOG: background worker "logical replication launcher" (PID 22853) exited with exit code 1
2026-08-08 02:41:20.675 UTC [22848] LOG: shutting down
2026-08-08 02:41:20.946 UTC [22843] LOG: database system is shut down
2026-08-08T02:41:20Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (69530 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:41:21 dist-test-slave-8tdl krb5kdc[24433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:41:21 dist-test-slave-8tdl krb5kdc[24433](info): set up 2 sockets
Aug 08 02:41:21 dist-test-slave-8tdl krb5kdc[24433](info): commencing operation
krb5kdc: starting...
W20260808 02:41:22.354017 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:41:22 dist-test-slave-8tdl krb5kdc[24433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:41:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:41:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:41:22.712436 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:36573
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:43789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:36573,127.10.20.125:43445,127.10.20.124:37875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:23.098923 24446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:23.099346 24446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:23.099514 24446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:23.107216 24446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:23.107404 24446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:23.107522 24446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:23.107643 24446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:23.107733 24446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:23.119541 24446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:43789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:36573,127.10.20.125:43445,127.10.20.124:37875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:36573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:23.121156 24446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:23.122641 24446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:23.137554 24455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:23.137554 24452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:23.137638 24453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:23.138907 24446 server_base.cc:1034] running on GCE node
I20260808 02:41:23.139871 24446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:23.141566 24446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:23.142872 24446 hybrid_clock.cc:648] HybridClock initialized: now 1786156883142805 us; error 59 us; skew 500 ppm
I20260808 02:41:23.143302 24446 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:23 dist-test-slave-8tdl krb5kdc[24433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:23.147213 24446 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:23.149165 24446 webserver.cc:460] Webserver started at http://127.10.20.126:38643/ using document root <none> and password file <none>
I20260808 02:41:23.149981 24446 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:23.150151 24446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:23.150484 24446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:23.153889 24446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "70a64c1cb7a64cee820c0fe4d54a02f7"
format_stamp: "Formatted at 2026-08-08 02:41:23 on dist-test-slave-8tdl"
server_key: "aca77393ef7b59f61dd13d19d74c1f99"
server_key_iv: "3e1a573aab1d44b9f49c358579b1bb68"
server_key_version: "encryptionkey@0"
I20260808 02:41:23.154927 24446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "70a64c1cb7a64cee820c0fe4d54a02f7"
format_stamp: "Formatted at 2026-08-08 02:41:23 on dist-test-slave-8tdl"
server_key: "aca77393ef7b59f61dd13d19d74c1f99"
server_key_iv: "3e1a573aab1d44b9f49c358579b1bb68"
server_key_version: "encryptionkey@0"
I20260808 02:41:23.160882 24446 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:41:23.165453 24462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:23.167299 24446 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:41:23.167551 24446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "70a64c1cb7a64cee820c0fe4d54a02f7"
format_stamp: "Formatted at 2026-08-08 02:41:23 on dist-test-slave-8tdl"
server_key: "aca77393ef7b59f61dd13d19d74c1f99"
server_key_iv: "3e1a573aab1d44b9f49c358579b1bb68"
server_key_version: "encryptionkey@0"
I20260808 02:41:23.167804 24446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:23.184582 24446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:23.189903 24446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:23.190259 24446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:23.212903 24446 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:36573
I20260808 02:41:23.212935 24514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:36573 every 8 connection(s)
I20260808 02:41:23.215008 24446 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:23.219530 24515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:23.219679 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24446
I20260808 02:41:23.219925 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:41:23.220809 10321 external_mini_cluster.cc:1428] Setting key 868d59b9c55173dc37fb1733fd6635b3
I20260808 02:41:23.231206 24515 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:41:23 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.20.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.125@KRBTEST.COM" created.
I20260808 02:41:23.259593 24519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.237697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59532 (local address 127.10.20.126:36573)
0808 02:41:23.238493 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:23.238504 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:23.238571 (+ 67us) server_negotiation.cc:407] Connection header received
0808 02:41:23.240427 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:23.240434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:23.240733 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:23.240976 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:23.242550 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.244079 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.245684 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.246318 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.246557 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.251185 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:23.251194 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:23.251209 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:23.251244 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:23.254540 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.255377 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.255386 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.255389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.255619 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.256097 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.256102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.256105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.256681 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:23.256923 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:23.257498 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 02:41:23.257927 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":567,"thread_start_us":371,"threads_started":1}
I20260808 02:41:23.259613 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.236149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:36573 (local address 127.0.0.1:59532)
0808 02:41:23.237153 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.237196 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:23.239930 (+ 2734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:23.241000 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:23.241008 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:23.241875 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:23.242302 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.242323 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.244271 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.244277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.245515 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.245528 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.246605 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.246613 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.246879 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.247679 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:23.247705 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:23.250899 (+ 3194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:23.254741 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.254755 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.254769 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.255220 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.255737 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.255745 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.255750 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.255968 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.256826 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:23.256841 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:23.257069 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 02:41:23.257349 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 02:41:23.258059 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":218,"thread_start_us":407,"threads_started":1}
I20260808 02:41:23.264108 24515 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:41:23.265566 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.265100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52788)
0808 02:41:23.265301 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.265434 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260808 02:41:23.265918 24466 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
I20260808 02:41:23.267869 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.267435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52792)
0808 02:41:23.267631 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.267706 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260808 02:41:23.268114 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:43445: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab.
Entry for principal kudu/127.10.20.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab.
I20260808 02:41:23.296141 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:43445
--webserver_interface=127.10.20.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab
--principal=kudu/127.10.20.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:43789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:36573,127.10.20.125:43445,127.10.20.124:37875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:23.317528 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } attempt: 1
I20260808 02:41:23.319264 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.318423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52802)
0808 02:41:23.318945 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.319113 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260808 02:41:23.320674 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.320162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52806)
0808 02:41:23.320374 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.320460 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 02:41:23.320932 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:43445: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
I20260808 02:41:23.389276 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } attempt: 2
I20260808 02:41:23.390569 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.390069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52812)
0808 02:41:23.390293 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.390393 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 02:41:23.392038 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.391511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52824)
0808 02:41:23.391711 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.391811 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260808 02:41:23.392341 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:43445: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
I20260808 02:41:23.483697 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } attempt: 3
I20260808 02:41:23.485469 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.484931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52826)
0808 02:41:23.485170 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.485319 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 02:41:23.486768 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.486271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52838)
0808 02:41:23.486444 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.486538 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 02:41:23.486979 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:43445: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
I20260808 02:41:23.630290 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } attempt: 4
I20260808 02:41:23.631788 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.631098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52848)
0808 02:41:23.631456 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.631582 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194}
I20260808 02:41:23.633010 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.632522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52852)
0808 02:41:23.632678 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.632783 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 02:41:23.633241 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:43445: Network error: Client connection negotiation failed: client connection to 127.10.20.125:43445: connect: Connection refused (error 111)
W20260808 02:41:23.703027 24522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:23.703753 24522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:23.703977 24522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:23.713442 24522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:23.713577 24522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:23.713670 24522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:23.713774 24522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:23.713856 24522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:23.729409 24522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:43789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:36573,127.10.20.125:43445,127.10.20.124:37875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab
--principal=kudu/127.10.20.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:43445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.20.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:23.731393 24522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:23.733155 24522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:23.749398 24527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:23.749821 24530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:23.749970 24528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:23.751187 24522 server_base.cc:1034] running on GCE node
I20260808 02:41:23.752589 24522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:23.754580 24522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:23.756037 24522 hybrid_clock.cc:648] HybridClock initialized: now 1786156883755925 us; error 85 us; skew 500 ppm
I20260808 02:41:23.756875 24522 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:23 dist-test-slave-8tdl krb5kdc[24433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:23.761053 24522 init.cc:377] Logged in from keytab as kudu/127.10.20.125@KRBTEST.COM (short username kudu)
I20260808 02:41:23.763301 24522 webserver.cc:460] Webserver started at http://127.10.20.125:42733/ using document root <none> and password file <none>
I20260808 02:41:23.764178 24522 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:23.764357 24522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:23.764788 24522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:23.768523 24522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data/instance:
uuid: "87a691350a794b50b82b1dc36836dcdd"
format_stamp: "Formatted at 2026-08-08 02:41:23 on dist-test-slave-8tdl"
server_key: "c9c874ab3dbeafc8b80e5ad316627d40"
server_key_iv: "2b270347adcf2e73f3fb04982c181b1b"
server_key_version: "encryptionkey@0"
I20260808 02:41:23.769595 24522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal/instance:
uuid: "87a691350a794b50b82b1dc36836dcdd"
format_stamp: "Formatted at 2026-08-08 02:41:23 on dist-test-slave-8tdl"
server_key: "c9c874ab3dbeafc8b80e5ad316627d40"
server_key_iv: "2b270347adcf2e73f3fb04982c181b1b"
server_key_version: "encryptionkey@0"
I20260808 02:41:23.778167 24522 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260808 02:41:23.785326 24537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:23.787580 24522 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.002s
I20260808 02:41:23.787854 24522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal
uuid: "87a691350a794b50b82b1dc36836dcdd"
format_stamp: "Formatted at 2026-08-08 02:41:23 on dist-test-slave-8tdl"
server_key: "c9c874ab3dbeafc8b80e5ad316627d40"
server_key_iv: "2b270347adcf2e73f3fb04982c181b1b"
server_key_version: "encryptionkey@0"
I20260808 02:41:23.788132 24522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:23.808216 24522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:23.814304 24522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:23.814738 24522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:23.839102 24522 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.125:43445
I20260808 02:41:23.839169 24590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.125:43445 every 8 connection(s)
I20260808 02:41:23.840747 24522 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
I20260808 02:41:23.845180 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24522
I20260808 02:41:23.845259 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:23.845453 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-1/wal/instance
I20260808 02:41:23.845943 10321 external_mini_cluster.cc:1428] Setting key e3e25e81179485e2922470f93c48576a
I20260808 02:41:23.853338 24591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:41:23 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.20.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.124@KRBTEST.COM" created.
I20260808 02:41:23.885673 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.857845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59534 (local address 127.10.20.126:36573)
0808 02:41:23.858432 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:23.858437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:23.860453 (+ 2016us) server_negotiation.cc:407] Connection header received
0808 02:41:23.862904 (+ 2451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:23.862913 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:23.863028 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:23.863175 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:23.865425 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.866731 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.868762 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.869754 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.870110 (+ 356us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.875660 (+ 5550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:23.875666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:23.875670 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:23.875723 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:23.880321 (+ 4598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.881474 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.881482 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.881491 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.881659 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.882812 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.882817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.882819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.883235 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:23.883417 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:23.885101 (+ 1684us) server_negotiation.cc:299] Negotiation successful
0808 02:41:23.885350 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":342,"threads_started":1}
I20260808 02:41:23.887446 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.858560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:36573 (local address 127.0.0.1:59534)
0808 02:41:23.860011 (+ 1451us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.860085 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:23.862496 (+ 2411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:23.863632 (+ 1136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:23.863643 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:23.864367 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:23.865091 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.865115 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.867004 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.867009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.868415 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.868433 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.870276 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.870286 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.870649 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.872146 (+ 1497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:23.872174 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:23.875284 (+ 3110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:23.880591 (+ 5307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.880601 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.880618 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.881255 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.881953 (+ 698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.881959 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.881962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.882556 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.883529 (+ 973us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:23.883545 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:23.884384 (+ 839us) client_negotiation.cc:769] Sending connection context
0808 02:41:23.884898 (+ 514us) client_negotiation.cc:240] Negotiation successful
0808 02:41:23.885615 (+ 717us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1090,"thread_start_us":770,"threads_started":1}
I20260808 02:41:23.889605 24591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:41:23 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:41:23.914080 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.890574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52866)
0808 02:41:23.890845 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.890868 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:23.891014 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:23.892793 (+ 1779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:23.892807 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:23.893414 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:23.893652 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.893669 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.896014 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.896022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.897883 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.897919 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.899567 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.899576 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.899871 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.901142 (+ 1271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:23.901163 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:23.905037 (+ 3874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:23.910814 (+ 5777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.910819 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.910822 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.911351 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.911968 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.911972 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.911975 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.912143 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.913196 (+ 1053us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:23.913201 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:23.913335 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 02:41:23.913462 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 02:41:23.913771 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 02:41:23.914585 24596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.890812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52866 (local address 127.10.20.125:43445)
0808 02:41:23.892024 (+ 1212us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:23.892034 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:23.892086 (+ 52us) server_negotiation.cc:407] Connection header received
0808 02:41:23.892176 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:23.892185 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:23.892570 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:23.892736 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:23.894059 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.895737 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.898258 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.899319 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.899520 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.905393 (+ 5873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:23.905428 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:23.905452 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:23.905517 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:23.910512 (+ 4995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.911526 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.911539 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.911545 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.911732 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.912287 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.912294 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.912300 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.912856 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:23.913083 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:23.913747 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 02:41:23.914093 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":902,"thread_start_us":553,"threads_started":1}
I20260808 02:41:23.917490 24591 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:41:23.919461 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.918534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41564)
0808 02:41:23.918841 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.919215 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260808 02:41:23.919849 24540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:23.921916 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.921469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41568)
0808 02:41:23.921666 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.921770 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 02:41:23.922413 24591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:23.932577 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } attempt: 5
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab.
Entry for principal kudu/127.10.20.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab.
I20260808 02:41:23.937390 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:37875
--webserver_interface=127.10.20.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab
--principal=kudu/127.10.20.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:43789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:36573,127.10.20.125:43445,127.10.20.124:37875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:41:23 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:41:23.951726 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.933622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:52868)
0808 02:41:23.933907 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.933933 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:23.934250 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:23.934985 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:23.934990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:23.935492 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:23.935757 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.935776 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.937424 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.937429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.938495 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:23.938512 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.939837 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.939843 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:23.940077 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.941003 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:23.941034 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:23.943673 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:23.948603 (+ 4930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.948613 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.948620 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.949251 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.949756 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:23.949763 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:23.949769 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:23.949951 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:23.950755 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:23.950763 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:23.950989 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 02:41:23.951207 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 02:41:23.951459 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260808 02:41:23.952301 24596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.933882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52868 (local address 127.10.20.125:43445)
0808 02:41:23.934463 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:23.934468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:23.934492 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:41:23.934555 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:23.934558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:23.934646 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:23.934826 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:23.935975 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.937209 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.938721 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:23.939603 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:23.939765 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:23.943973 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:23.943983 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:23.943992 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:23.944062 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:23.948373 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.949418 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.949426 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.949432 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.949611 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:23.950119 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:23.950131 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:23.950137 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:23.950580 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:23.950761 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:23.951365 (+ 604us) server_negotiation.cc:299] Negotiation successful
0808 02:41:23.951673 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378}
I20260808 02:41:23.953549 24515 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:41:23.954890 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.954360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41570)
0808 02:41:23.954556 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.954656 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 02:41:23.956111 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.955696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41582)
0808 02:41:23.955864 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.955959 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 02:41:23.956354 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:23.971877 24591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 1
I20260808 02:41:23.973418 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.972762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41584)
0808 02:41:23.973035 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.973188 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 02:41:23.975216 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:23.974668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41590)
0808 02:41:23.974943 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:23.975044 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260808 02:41:23.975486 24591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:24.007661 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 1
I20260808 02:41:24.009243 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.008472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41598)
0808 02:41:24.008796 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.008949 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260808 02:41:24.010903 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.010240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41608)
0808 02:41:24.010500 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.010638 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 02:41:24.011286 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:24.043869 24591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 2
I20260808 02:41:24.045895 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.045115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41624)
0808 02:41:24.045508 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.045668 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260808 02:41:24.048134 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.047393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41628)
0808 02:41:24.047733 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.047885 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260808 02:41:24.048596 24591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:24.079566 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 2
I20260808 02:41:24.080974 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.080297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41644)
0808 02:41:24.080605 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.080732 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 02:41:24.082628 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.082139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41648)
0808 02:41:24.082334 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.082456 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 02:41:24.083093 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:24.139974 24591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 3
I20260808 02:41:24.141520 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.140949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41660)
0808 02:41:24.141223 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.141331 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 02:41:24.142894 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.142348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41666)
0808 02:41:24.142599 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.142746 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
W20260808 02:41:24.143201 24591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:24.189450 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 3
I20260808 02:41:24.191138 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.190332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41682)
0808 02:41:24.190657 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.190850 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 02:41:24.192634 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.192089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:41688)
0808 02:41:24.192360 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.192461 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260808 02:41:24.193069 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
I20260808 02:41:24.286543 24591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 4
I20260808 02:41:24.287894 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.287411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55606)
0808 02:41:24.287626 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.287720 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 02:41:24.289024 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.288642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55614)
0808 02:41:24.288834 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.288907 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 02:41:24.289247 24591 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
W20260808 02:41:24.365484 24599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:24.365962 24599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:24.366163 24599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 02:41:24.370343 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 4
I20260808 02:41:24.371856 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.371215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55622)
0808 02:41:24.371476 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.371605 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 02:41:24.373421 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.372802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55634)
0808 02:41:24.373175 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.373262 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
W20260808 02:41:24.373728 24515 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:37875: Network error: Client connection negotiation failed: client connection to 127.10.20.124:37875: connect: Connection refused (error 111)
W20260808 02:41:24.376081 24599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:24.376255 24599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:24.376366 24599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:24.376499 24599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:24.376595 24599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:24.388429 24599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:43789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:36573,127.10.20.125:43445,127.10.20.124:37875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab
--principal=kudu/127.10.20.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:37875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.20.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:24.390599 24599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:24.392321 24599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:24.406859 24608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:24.406850 24606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:24.406863 24604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:24.408144 24599 server_base.cc:1034] running on GCE node
I20260808 02:41:24.409291 24599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:24.411103 24599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:24.412377 24599 hybrid_clock.cc:648] HybridClock initialized: now 1786156884412300 us; error 71 us; skew 500 ppm
I20260808 02:41:24.412846 24599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156884, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:24.416689 24599 init.cc:377] Logged in from keytab as kudu/127.10.20.124@KRBTEST.COM (short username kudu)
I20260808 02:41:24.418949 24599 webserver.cc:460] Webserver started at http://127.10.20.124:35305/ using document root <none> and password file <none>
I20260808 02:41:24.420077 24599 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:24.420277 24599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:24.420933 24599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:24.424741 24599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data/instance:
uuid: "2081836f4e9e4dea929f42416817eba9"
format_stamp: "Formatted at 2026-08-08 02:41:24 on dist-test-slave-8tdl"
server_key: "5ca4294b84244bb97aab5b39be489081"
server_key_iv: "872d0b9644d4eaa9cbe9958173777f38"
server_key_version: "encryptionkey@0"
I20260808 02:41:24.425752 24599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal/instance:
uuid: "2081836f4e9e4dea929f42416817eba9"
format_stamp: "Formatted at 2026-08-08 02:41:24 on dist-test-slave-8tdl"
server_key: "5ca4294b84244bb97aab5b39be489081"
server_key_iv: "872d0b9644d4eaa9cbe9958173777f38"
server_key_version: "encryptionkey@0"
I20260808 02:41:24.432641 24599 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260808 02:41:24.437453 24615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:24.439608 24599 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:41:24.439859 24599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal
uuid: "2081836f4e9e4dea929f42416817eba9"
format_stamp: "Formatted at 2026-08-08 02:41:24 on dist-test-slave-8tdl"
server_key: "5ca4294b84244bb97aab5b39be489081"
server_key_iv: "872d0b9644d4eaa9cbe9958173777f38"
server_key_version: "encryptionkey@0"
I20260808 02:41:24.440127 24599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:24.464643 24599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:24.469834 24599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:24.470214 24599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:24.492849 24599 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.124:37875
I20260808 02:41:24.492920 24667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.124:37875 every 8 connection(s)
I20260808 02:41:24.494482 24599 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
I20260808 02:41:24.498894 24668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:24.499089 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24599
I20260808 02:41:24.499321 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786156633487900-10321-0/minicluster-data/master-2/wal/instance
I20260808 02:41:24.499832 10321 external_mini_cluster.cc:1428] Setting key 768e0361ae0e6193508171139462baab
I20260808 02:41:24.509605 24668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156884, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:24.530939 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.502253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55646 (local address 127.10.20.124:37875)
0808 02:41:24.503268 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.503285 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.503334 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:41:24.505644 (+ 2310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.505675 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.506208 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.506616 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.509043 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.510543 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.512681 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.514116 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.514322 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.519846 (+ 5524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.519860 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.519880 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.520002 (+ 122us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.524365 (+ 4363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.525842 (+ 1477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.525852 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.525864 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.526080 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.526932 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.526940 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.526945 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.527872 (+ 927us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.528209 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.528847 (+ 638us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.529366 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":482,"threads_started":1}
I20260808 02:41:24.534723 24673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.513225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:36573 (local address 127.0.0.1:33510)
0808 02:41:24.514260 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.514309 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:24.514509 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:24.515085 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:24.515091 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:24.516042 (+ 951us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:24.516471 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.516488 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.517741 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.517749 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.519284 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.519303 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.520521 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.520527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.520668 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.521566 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:24.521586 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:24.525041 (+ 3455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:24.529888 (+ 4847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.529900 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.529907 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.530524 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.532370 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.532378 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.532385 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.532580 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.533242 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:24.533250 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:24.533501 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 02:41:24.533745 (+ 244us) client_negotiation.cc:240] Negotiation successful
0808 02:41:24.534232 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":577,"threads_started":1}
I20260808 02:41:24.534771 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.513177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33510 (local address 127.10.20.126:36573)
0808 02:41:24.513801 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.513810 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.514619 (+ 809us) server_negotiation.cc:407] Connection header received
0808 02:41:24.514765 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.514769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.514865 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.514958 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.516764 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.517526 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.519552 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.520250 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.520402 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.525532 (+ 5130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.525538 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.525542 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.525593 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.529721 (+ 4128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.530768 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.530774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.530776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.531070 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.532724 (+ 1654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.532730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.532734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.533081 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.533259 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.533935 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.534229 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":355,"threads_started":1}
I20260808 02:41:24.536716 24668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156884, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:41:24.552873 24673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.537667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:43445 (local address 127.0.0.1:36326)
0808 02:41:24.537885 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.537908 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:24.538035 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:24.538577 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:24.538583 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:24.539032 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:24.539187 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.539197 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.540244 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.540250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.541201 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.541213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.542004 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.542010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.542200 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.542937 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:24.542958 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:24.545684 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:24.549697 (+ 4013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.549703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.549707 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.550269 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.550917 (+ 648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.550924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.550927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.551186 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.551872 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:24.551876 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:24.552069 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 02:41:24.552228 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 02:41:24.552564 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 02:41:24.553237 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.537675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36326 (local address 127.10.20.125:43445)
0808 02:41:24.538279 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.538284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.538300 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:41:24.538350 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.538354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.538412 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.538541 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.539353 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.540084 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.541383 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.541830 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.541974 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.546032 (+ 4058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.546040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.546044 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.546097 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.549449 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.550429 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.550435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.550438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.550624 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.551304 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.551310 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.551313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.551728 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.551849 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.552460 (+ 611us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.552729 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":361,"threads_started":1}
I20260808 02:41:24.553543 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.535090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33518 (local address 127.10.20.126:36573)
0808 02:41:24.535271 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.535277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.535452 (+ 175us) server_negotiation.cc:407] Connection header received
0808 02:41:24.535560 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.535565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.535657 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.535769 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.537356 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.538376 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.539850 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.540301 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.540451 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.546484 (+ 6033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.546490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.546493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.546550 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.549853 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.550952 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.550958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.550961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.551120 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.551691 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.551695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.551697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.552116 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.552443 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.552932 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.553214 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 02:41:24.554486 24668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156884, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:41:24.570886 24673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.555340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55652)
0808 02:41:24.555842 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.555863 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:24.555989 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:24.556543 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:24.556547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:24.556992 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:24.557134 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.557142 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.558116 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.558123 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.559163 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.559176 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.559903 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.559911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.560108 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.560917 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:24.560937 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:24.564021 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:24.567777 (+ 3756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.567786 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.567792 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.568298 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.568828 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.568832 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.568834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.568992 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.569752 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:24.569756 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:24.569899 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 02:41:24.570192 (+ 293us) client_negotiation.cc:240] Negotiation successful
0808 02:41:24.570486 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 02:41:24.571372 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.555660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55652 (local address 127.10.20.124:37875)
0808 02:41:24.555842 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.555849 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.555921 (+ 72us) server_negotiation.cc:407] Connection header received
0808 02:41:24.556336 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.556342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.556433 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.556522 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.557277 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.557984 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.559305 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.559727 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.559873 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.564235 (+ 4362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.564242 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.564246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.564314 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.567592 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.568443 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.568450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.568454 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.568629 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.569135 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.569143 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.569149 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.569591 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.569767 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.570291 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.570747 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":119,"server-negotiator.queue_time_us":61}
I20260808 02:41:24.575541 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.556200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36340 (local address 127.10.20.125:43445)
0808 02:41:24.556424 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.556428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.556445 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:41:24.556494 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.556498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.556556 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.556693 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.558181 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.558984 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.560548 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.561142 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.561393 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.567241 (+ 5848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.567247 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.567251 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.567295 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.571432 (+ 4137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.572786 (+ 1354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.572796 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.572801 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.573049 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.573680 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.573685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.573687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.574040 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.574280 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.574885 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.575122 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:41:24.577934 24668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: Bootstrap starting.
I20260808 02:41:24.581918 24668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:24.582589 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:41:24.583356 24668 log.cc:824] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:24.587288 24668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: No bootstrap required, opened a new log
I20260808 02:41:24.588467 24591 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 5
I20260808 02:41:24.604064 24668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.605106 24668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:24.605340 24668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2081836f4e9e4dea929f42416817eba9, State: Initialized, Role: FOLLOWER
I20260808 02:41:24.607049 24668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.625341 24685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.626086 24685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:41:24.626627 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.589173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33526 (local address 127.10.20.126:36573)
0808 02:41:24.589370 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.589378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.604919 (+ 15541us) server_negotiation.cc:407] Connection header received
0808 02:41:24.606018 (+ 1099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.606026 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.606246 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.606343 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.609567 (+ 3224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.611006 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.613447 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.614165 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.614279 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.618862 (+ 4583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.618870 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.618875 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.618940 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.622946 (+ 4006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.623955 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.623965 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.623968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.624169 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.624704 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.624711 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.624716 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.625160 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.625452 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.626074 (+ 622us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.626353 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
I20260808 02:41:24.627425 24668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:24.636984 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.588809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.10.20.124:37875)
0808 02:41:24.589504 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.589513 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.606623 (+ 17110us) server_negotiation.cc:407] Connection header received
0808 02:41:24.606953 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.606959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.607052 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.607146 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.610240 (+ 3094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.612000 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.615676 (+ 3676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.616711 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.616863 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.622354 (+ 5491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.622365 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.622373 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.622443 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.629892 (+ 7449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.633881 (+ 3989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.633890 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.633895 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.634158 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.634737 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.634745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.634749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.635326 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.635616 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.636273 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.636552 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521}
I20260808 02:41:24.640638 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.589173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55676)
0808 02:41:24.589696 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.589723 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:24.589882 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:24.611799 (+ 21917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:24.611807 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:24.612373 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:24.612621 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.612634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.618786 (+ 6152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.618792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.620351 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.620374 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.623699 (+ 3325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.623707 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.623978 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.624645 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:24.624681 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:24.629238 (+ 4557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:24.635823 (+ 6585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.635833 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.635841 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.636930 (+ 1089us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.637643 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.637653 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.637660 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.637951 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.639515 (+ 1564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:24.639521 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:24.639690 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 02:41:24.639843 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 02:41:24.640169 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367}
I20260808 02:41:24.640704 24674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.589178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36346 (local address 127.10.20.125:43445)
0808 02:41:24.589372 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.589378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.606212 (+ 16834us) server_negotiation.cc:407] Connection header received
0808 02:41:24.607490 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.607496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.607583 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.607664 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.615030 (+ 7366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.616242 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.621714 (+ 5472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.622385 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.622517 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.633078 (+ 10561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.633087 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.633092 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.633146 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.637207 (+ 4061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.638152 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.638158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.638161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.638332 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.638887 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.638892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.638895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.639295 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.639582 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.639980 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.640354 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":110,"server-negotiator.queue_time_us":65}
I20260808 02:41:24.642264 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.590263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55676 (local address 127.10.20.124:37875)
0808 02:41:24.611252 (+ 20989us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.611260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.611290 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:41:24.611351 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.611356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.611448 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.612804 (+ 1356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.613128 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.614792 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.620631 (+ 5839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.621491 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.624318 (+ 2827us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.629734 (+ 5416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.629746 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.629754 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.629820 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.635521 (+ 5701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.637168 (+ 1647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.637177 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.637183 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.637434 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.638266 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.638276 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.638282 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.639068 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.640842 (+ 1774us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.641064 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.641401 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20776,"thread_start_us":21293,"threads_started":1}
I20260808 02:41:24.648604 24591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: Bootstrap starting.
I20260808 02:41:24.650943 24515 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } attempt: 5
I20260808 02:41:24.656919 24591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:24.658495 24591 log.cc:824] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: Log is configured to *not* fsync() on all Append() calls
Aug 08 02:41:24 dist-test-slave-8tdl krb5kdc[24433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
I20260808 02:41:24.648957 24599 master_runner.cc:186] Error getting master registration for 127.10.20.126:36573: OK, instance_id { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" instance_seqno: 1786156883206474 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:41:24.666787 24599 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 02:41:24.670444 24696 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:41:24.670610 24696 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:41:24.672453 24518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.651644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:37875 (local address 127.0.0.1:55680)
0808 02:41:24.652068 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:24.652091 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:24.652303 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:24.653410 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:24.653415 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:24.654008 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:24.654249 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.654266 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.655861 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.655866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.657474 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:24.657498 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.658930 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.658936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:24.659178 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.660178 (+ 1000us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:24.660216 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:24.663401 (+ 3185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:24.668912 (+ 5511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.668917 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.668921 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.669556 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.670129 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:24.670136 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:24.670140 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:24.670364 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:24.671265 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:24.671272 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:24.671439 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 02:41:24.671597 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 02:41:24.671970 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269}
I20260808 02:41:24.672824 24591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: No bootstrap required, opened a new log
I20260808 02:41:24.673400 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:24.652618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55680 (local address 127.10.20.124:37875)
0808 02:41:24.652834 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:24.652839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:24.652859 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:41:24.652923 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:24.652929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:24.653065 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:24.653166 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:24.654426 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.655643 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.657702 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:24.658511 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:24.658658 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:24.663672 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:24.663678 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:24.663682 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:24.663722 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:24.668652 (+ 4930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.669759 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.669765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.669768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.669952 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:24.670509 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:24.670515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:24.670518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:24.671011 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:24.671185 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:24.672872 (+ 1687us) server_negotiation.cc:299] Negotiation successful
0808 02:41:24.673167 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:41:24.678045 24515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: Bootstrap starting.
I20260808 02:41:24.681815 24515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:24.683426 24515 log.cc:824] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:24.685003 24591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.685520 24591 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:24.685698 24591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a691350a794b50b82b1dc36836dcdd, State: Initialized, Role: FOLLOWER
I20260808 02:41:24.686616 24591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.687842 24700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.688355 24700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:41:24.689433 24515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: No bootstrap required, opened a new log
I20260808 02:41:24.689584 24591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:24.706421 24515 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.707124 24515 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:24.707329 24515 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70a64c1cb7a64cee820c0fe4d54a02f7, State: Initialized, Role: FOLLOWER
I20260808 02:41:24.708159 24515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.702196 24522 master_runner.cc:186] Error getting master registration for 127.10.20.126:36573: OK, instance_id { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" instance_seqno: 1786156883206474 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:41:24.714169 24522 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 02:41:24.719488 24711 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:41:24.719787 24711 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:41:24.722497 24515 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:41:24.722970 24622 tablet.cc:2369] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:24.726167 24713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.726835 24713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:41:24.747014 24446 master_runner.cc:263] No leader master found from master 70a64c1cb7a64cee820c0fe4d54a02f7
I20260808 02:41:24.747208 24446 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 02:41:24.757431 24724 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:41:24.757640 24724 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:41:24.781076 24700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:41:24.781527 24700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.785770 24490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87a691350a794b50b82b1dc36836dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" is_pre_election: true
I20260808 02:41:24.786597 24490 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a691350a794b50b82b1dc36836dcdd in term 0.
I20260808 02:41:24.787609 24539 leader_election.cc:302] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70a64c1cb7a64cee820c0fe4d54a02f7, 87a691350a794b50b82b1dc36836dcdd; no voters:
I20260808 02:41:24.794656 24643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87a691350a794b50b82b1dc36836dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2081836f4e9e4dea929f42416817eba9" is_pre_election: true
I20260808 02:41:24.795878 24643 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a691350a794b50b82b1dc36836dcdd in term 0.
I20260808 02:41:24.797119 24700 leader_election.cc:288] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70a64c1cb7a64cee820c0fe4d54a02f7 (127.10.20.126:36573), 2081836f4e9e4dea929f42416817eba9 (127.10.20.124:37875)
I20260808 02:41:24.797441 24700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:41:24.797634 24700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:41:24.797765 24700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:24.803568 24700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.811704 24490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87a691350a794b50b82b1dc36836dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7"
I20260808 02:41:24.812017 24490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:24.815742 24643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87a691350a794b50b82b1dc36836dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2081836f4e9e4dea929f42416817eba9"
I20260808 02:41:24.816049 24643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:24.815909 24490 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a691350a794b50b82b1dc36836dcdd in term 1.
W20260808 02:41:24.818531 24544 tablet.cc:2369] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:24.818925 24539 leader_election.cc:302] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70a64c1cb7a64cee820c0fe4d54a02f7, 87a691350a794b50b82b1dc36836dcdd; no voters:
I20260808 02:41:24.819311 24726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:24.821463 24643 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a691350a794b50b82b1dc36836dcdd in term 1.
I20260808 02:41:24.822211 24700 leader_election.cc:288] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [CANDIDATE]: Term 1 election: Requested vote from peers 70a64c1cb7a64cee820c0fe4d54a02f7 (127.10.20.126:36573), 2081836f4e9e4dea929f42416817eba9 (127.10.20.124:37875)
I20260808 02:41:24.829202 24726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [term 1 LEADER]: Becoming Leader. State: Replica: 87a691350a794b50b82b1dc36836dcdd, State: Running, Role: LEADER
I20260808 02:41:24.831616 24726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } }
I20260808 02:41:24.856042 24700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87a691350a794b50b82b1dc36836dcdd. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.856479 24700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:24.867095 24729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:24.869707 24729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:24.905010 24643 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [term 1 FOLLOWER]: Refusing update from remote peer 87a691350a794b50b82b1dc36836dcdd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:24.906358 24700 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:24.915071 24490 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [term 1 FOLLOWER]: Refusing update from remote peer 87a691350a794b50b82b1dc36836dcdd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:24.916195 24700 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:24.938531 24685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87a691350a794b50b82b1dc36836dcdd. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.939028 24685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 02:41:24.944242 24468 tablet.cc:2369] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:24.946228 24713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87a691350a794b50b82b1dc36836dcdd. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.946637 24713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:41:24.947099 24730 mvcc.cc:205] Tried to move back new op lower bound from 7316098600530661376 to 7316098600278249472. Current Snapshot: MvccSnapshot[applied={T|T < 7316098600530661376}]
I20260808 02:41:24.958220 24726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.958727 24726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:24.959074 24726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.959367 24726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:24.960158 24685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.960451 24685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:41:24.962092 24729 catalog_manager.cc:1347] Generated new cluster ID: a7fadb547662421ba6eb6d899f4c7c8a
I20260808 02:41:24.962230 24729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:24.980062 24713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87a691350a794b50b82b1dc36836dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a64c1cb7a64cee820c0fe4d54a02f7" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36573 } } peers { permanent_uuid: "87a691350a794b50b82b1dc36836dcdd" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 43445 } } peers { permanent_uuid: "2081836f4e9e4dea929f42416817eba9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 37875 } } }
I20260808 02:41:24.980465 24713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:41:24.986557 24729 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:41:24.988580 24729 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:25.013119 24729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87a691350a794b50b82b1dc36836dcdd: Generated new TSK 0
I20260808 02:41:25.014400 24729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:41:25.673103 24696 catalog_manager.cc:1259] Loaded cluster ID: a7fadb547662421ba6eb6d899f4c7c8a
I20260808 02:41:25.673221 24696 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: loading cluster ID for follower catalog manager: success
I20260808 02:41:25.676167 24696 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: acquiring CA information for follower catalog manager: success
I20260808 02:41:25.678436 24696 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2081836f4e9e4dea929f42416817eba9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:41:25.760084 24724 catalog_manager.cc:1259] Loaded cluster ID: a7fadb547662421ba6eb6d899f4c7c8a
I20260808 02:41:25.760212 24724 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: loading cluster ID for follower catalog manager: success
I20260808 02:41:25.763190 24724 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: acquiring CA information for follower catalog manager: success
I20260808 02:41:25.765441 24724 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 70a64c1cb7a64cee820c0fe4d54a02f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:41:26.163944 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24446
I20260808 02:41:26.166994 24510 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:26.285980 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24446
I20260808 02:41:26.316576 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24522
I20260808 02:41:26.318519 24586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:26.445533 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24522
I20260808 02:41:26.472338 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24599
I20260808 02:41:26.473832 24663 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:26.591867 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24599
2026-08-08T02:41:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5494 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:41:26 dist-test-slave-8tdl krb5kdc[24746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:41:26 dist-test-slave-8tdl krb5kdc[24746](info): set up 2 sockets
Aug 08 02:41:26 dist-test-slave-8tdl krb5kdc[24746](info): commencing operation
krb5kdc: starting...
W20260808 02:41:27.853076 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:41:28 dist-test-slave-8tdl krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:41:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:41:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:41:28.226186 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44635
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:32881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:44635
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:28.643234 24759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:28.643595 24759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:28.643754 24759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:28.652779 24759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:28.652942 24759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:28.652997 24759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:28.653126 24759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:28.653213 24759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:28.664948 24759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:32881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:44635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:28.666661 24759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:28.668365 24759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:28.685294 24764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:28.685515 24765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:28.686160 24767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:28.686771 24759 server_base.cc:1034] running on GCE node
I20260808 02:41:28.688112 24759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:28.690231 24759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:28.691730 24759 hybrid_clock.cc:648] HybridClock initialized: now 1786156888691663 us; error 121 us; skew 500 ppm
I20260808 02:41:28.692143 24759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:28 dist-test-slave-8tdl krb5kdc[24746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156888, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:28.695982 24759 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:28.698421 24759 webserver.cc:460] Webserver started at http://127.10.20.126:33153/ using document root <none> and password file <none>
I20260808 02:41:28.699391 24759 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:28.699577 24759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:28.699954 24759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:28.704078 24759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "c3da9886aab449a1b5a39a0848827966"
format_stamp: "Formatted at 2026-08-08 02:41:28 on dist-test-slave-8tdl"
server_key: "719b384b5b1b6c9fc8b3f8b688a6e53f"
server_key_iv: "b621092b105f7ed1f0fdf0f81fb70cae"
server_key_version: "encryptionkey@0"
I20260808 02:41:28.705432 24759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "c3da9886aab449a1b5a39a0848827966"
format_stamp: "Formatted at 2026-08-08 02:41:28 on dist-test-slave-8tdl"
server_key: "719b384b5b1b6c9fc8b3f8b688a6e53f"
server_key_iv: "b621092b105f7ed1f0fdf0f81fb70cae"
server_key_version: "encryptionkey@0"
I20260808 02:41:28.712004 24759 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:41:28.716451 24774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:28.718323 24759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:41:28.718618 24759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "c3da9886aab449a1b5a39a0848827966"
format_stamp: "Formatted at 2026-08-08 02:41:28 on dist-test-slave-8tdl"
server_key: "719b384b5b1b6c9fc8b3f8b688a6e53f"
server_key_iv: "b621092b105f7ed1f0fdf0f81fb70cae"
server_key_version: "encryptionkey@0"
I20260808 02:41:28.718953 24759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:28.741158 24759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:28.746953 24759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:28.747298 24759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:28.771601 24759 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:44635
I20260808 02:41:28.771721 24828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:44635 every 8 connection(s)
I20260808 02:41:28.773280 24759 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:28.777985 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24759
I20260808 02:41:28.778200 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:41:28.778888 10321 external_mini_cluster.cc:1428] Setting key 5bb11261713146b5e299d29ca28ccf15
I20260808 02:41:28.780772 24829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:41:28 dist-test-slave-8tdl krb5kdc[24746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:28.800150 24829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966: Bootstrap starting.
I20260808 02:41:28.805907 24829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:28.807739 24829 log.cc:824] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:28.812008 24829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966: No bootstrap required, opened a new log
I20260808 02:41:28.813210 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:28.781365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49652 (local address 127.10.20.126:44635)
0808 02:41:28.782902 (+ 1537us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:28.782926 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:28.782986 (+ 60us) server_negotiation.cc:407] Connection header received
0808 02:41:28.785385 (+ 2399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:28.785416 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:28.786092 (+ 676us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:28.786582 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:28.789181 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:28.790942 (+ 1761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:28.793223 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:28.794127 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:28.794307 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:28.801681 (+ 7374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:28.801693 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:28.801713 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:28.801779 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:28.807382 (+ 5603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:28.808715 (+ 1333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:28.808726 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:28.808738 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:28.809021 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:28.809596 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:28.809604 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:28.809613 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:28.810496 (+ 883us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:28.810908 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:28.811473 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 02:41:28.812004 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":1206,"thread_start_us":909,"threads_started":1}
I20260808 02:41:28.818869 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:41:28.822781 24829 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3da9886aab449a1b5a39a0848827966" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44635 } }
I20260808 02:41:28.823472 24829 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:28.823871 24829 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3da9886aab449a1b5a39a0848827966, State: Initialized, Role: FOLLOWER
I20260808 02:41:28.824856 24829 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3da9886aab449a1b5a39a0848827966" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44635 } }
I20260808 02:41:28.825176 24829 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:28.825464 24829 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:28.825742 24829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:28.828645 24829 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3da9886aab449a1b5a39a0848827966" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44635 } }
I20260808 02:41:28.829352 24829 leader_election.cc:302] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3da9886aab449a1b5a39a0848827966; no voters:
I20260808 02:41:28.830148 24829 leader_election.cc:288] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:41:28.830343 24834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:28.831832 24834 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [term 1 LEADER]: Becoming Leader. State: Replica: c3da9886aab449a1b5a39a0848827966, State: Running, Role: LEADER
I20260808 02:41:28.832576 24834 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3da9886aab449a1b5a39a0848827966" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44635 } }
I20260808 02:41:28.833173 24829 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:28.836956 24835 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3da9886aab449a1b5a39a0848827966" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3da9886aab449a1b5a39a0848827966" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44635 } } }
I20260808 02:41:28.837839 24835 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:28.837013 24836 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3da9886aab449a1b5a39a0848827966. Latest consensus state: current_term: 1 leader_uuid: "c3da9886aab449a1b5a39a0848827966" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3da9886aab449a1b5a39a0848827966" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44635 } } }
I20260808 02:41:28.838316 24836 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:28.840265 24843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:28.848940 24843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:28.863742 24843 catalog_manager.cc:1347] Generated new cluster ID: a77d94d6d998435eaeaca53788f0a30c
I20260808 02:41:28.863961 24843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:28.876463 24843 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:41:28.878187 24843 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:28.891723 24843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3da9886aab449a1b5a39a0848827966: Generated new TSK 0
I20260808 02:41:28.893103 24843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:41:28.938206 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24759
I20260808 02:41:28.940348 24824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:29.053856 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24759
2026-08-08T02:41:29Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2462 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:41:29 dist-test-slave-8tdl krb5kdc[24857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:41:29 dist-test-slave-8tdl krb5kdc[24857](info): set up 2 sockets
Aug 08 02:41:29 dist-test-slave-8tdl krb5kdc[24857](info): commencing operation
krb5kdc: starting...
W20260808 02:41:30.338747 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:41:30 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:41:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:41:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:41:30.710911 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44987
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:44987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:31.103124 24870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:31.103467 24870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:31.103633 24870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:31.111668 24870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:31.111809 24870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:31.111918 24870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:31.112072 24870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:31.112146 24870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:31.123222 24870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:44987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:31.124782 24870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:31.126230 24870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:31.139561 24875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:31.139523 24878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:31.139602 24876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:31.140403 24870 server_base.cc:1034] running on GCE node
I20260808 02:41:31.141338 24870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:31.142978 24870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:31.144234 24870 hybrid_clock.cc:648] HybridClock initialized: now 1786156891144171 us; error 49 us; skew 500 ppm
I20260808 02:41:31.144780 24870 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:31 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156891, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:31.148731 24870 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:31.151041 24870 webserver.cc:460] Webserver started at http://127.10.20.126:33271/ using document root <none> and password file <none>
I20260808 02:41:31.151898 24870 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:31.152083 24870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:31.152449 24870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:31.156133 24870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "80c28a2ea0a741d9be542206f29be7d6"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "f02e26d98d034de34c53b0363dd21faf"
server_key_iv: "010578436bb13907763f1170866175d1"
server_key_version: "encryptionkey@0"
I20260808 02:41:31.156996 24870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "80c28a2ea0a741d9be542206f29be7d6"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "f02e26d98d034de34c53b0363dd21faf"
server_key_iv: "010578436bb13907763f1170866175d1"
server_key_version: "encryptionkey@0"
I20260808 02:41:31.163245 24870 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 02:41:31.167529 24885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:31.169305 24870 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:41:31.169652 24870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "80c28a2ea0a741d9be542206f29be7d6"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "f02e26d98d034de34c53b0363dd21faf"
server_key_iv: "010578436bb13907763f1170866175d1"
server_key_version: "encryptionkey@0"
I20260808 02:41:31.169881 24870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:31.192296 24870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:31.197822 24870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:31.198170 24870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:31.220294 24870 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:44987
I20260808 02:41:31.220309 24937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:44987 every 8 connection(s)
I20260808 02:41:31.221999 24870 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:31.226364 24938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:31.227475 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24870
I20260808 02:41:31.227772 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:41:31.228616 10321 external_mini_cluster.cc:1428] Setting key da040cf3a72967c966799a1c17f83585
I20260808 02:41:31.243237 24938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap starting.
Aug 08 02:41:31 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:31.246984 24938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:31.248468 24938 log.cc:824] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:31.253109 24938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: No bootstrap required, opened a new log
I20260808 02:41:31.257913 24941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:31.231289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33798 (local address 127.10.20.126:44987)
0808 02:41:31.232338 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:31.232365 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:31.232431 (+ 66us) server_negotiation.cc:407] Connection header received
0808 02:41:31.234597 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:31.234634 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:31.235452 (+ 818us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:31.235990 (+ 538us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:31.237674 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:31.239896 (+ 2222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:31.241583 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:31.242731 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:31.242961 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:31.247766 (+ 4805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:31.247778 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:31.247799 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:31.247872 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:31.252653 (+ 4781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:31.253853 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:31.253865 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:31.253875 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:31.254192 (+ 317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:31.254855 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:31.254859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:31.254862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:31.255493 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:31.255772 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:31.256346 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 02:41:31.256774 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":440,"threads_started":1}
I20260808 02:41:31.263409 24938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:31.263929 24938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:31.264045 24938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80c28a2ea0a741d9be542206f29be7d6, State: Initialized, Role: FOLLOWER
I20260808 02:41:31.264717 24938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:31.264987 24938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:31.265281 24938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:31.265635 24938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:31.268648 24938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:31.269345 24938 leader_election.cc:302] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80c28a2ea0a741d9be542206f29be7d6; no voters:
I20260808 02:41:31.270074 24938 leader_election.cc:288] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:41:31.270234 24943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:31.271135 24943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 LEADER]: Becoming Leader. State: Replica: 80c28a2ea0a741d9be542206f29be7d6, State: Running, Role: LEADER
I20260808 02:41:31.271811 24943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:31.272675 24938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:31.275442 24945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80c28a2ea0a741d9be542206f29be7d6. Latest consensus state: current_term: 1 leader_uuid: "80c28a2ea0a741d9be542206f29be7d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } } }
I20260808 02:41:31.275365 24944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80c28a2ea0a741d9be542206f29be7d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } } }
I20260808 02:41:31.276081 24944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:31.276965 24945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:31.278990 24950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:31.287067 24950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:31.299921 24950 catalog_manager.cc:1347] Generated new cluster ID: 07bf9f045c854c19b5aa22b3797cb48e
I20260808 02:41:31.300086 24950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:31.325960 24950 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:41:31.327608 24950 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:31.342098 24950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Generated new TSK 0
I20260808 02:41:31.343217 24950 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:41:31.440773 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:44987
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:31.836763 24964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:31.837145 24964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:31.837334 24964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:31.845793 24964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:31.845978 24964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:31.846166 24964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:41:31.857223 24964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:31.858783 24964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:31.860302 24964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:31.877173 24970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:31.877345 24964 server_base.cc:1034] running on GCE node
W20260808 02:41:31.877125 24969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:31.877213 24972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:31.878494 24964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:31.879706 24964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:31.881004 24964 hybrid_clock.cc:648] HybridClock initialized: now 1786156891880919 us; error 69 us; skew 500 ppm
I20260808 02:41:31.881466 24964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:31 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156891, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:31.893256 24964 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:41:31.895324 24964 webserver.cc:460] Webserver started at http://127.10.20.65:38161/ using document root <none> and password file <none>
I20260808 02:41:31.896158 24964 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:31.896325 24964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:31.896685 24964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:31.900156 24964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "f6e27949598a4fcd8770f20d76b7f620"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "3d7a1c351cde8e93958fe20813f71a2f"
server_key_iv: "7ef3f5bd06b8636e14c1544031e86aad"
server_key_version: "encryptionkey@0"
I20260808 02:41:31.901098 24964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "f6e27949598a4fcd8770f20d76b7f620"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "3d7a1c351cde8e93958fe20813f71a2f"
server_key_iv: "7ef3f5bd06b8636e14c1544031e86aad"
server_key_version: "encryptionkey@0"
I20260808 02:41:31.907490 24964 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:41:31.911902 24980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:31.913726 24964 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260808 02:41:31.914019 24964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "f6e27949598a4fcd8770f20d76b7f620"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "3d7a1c351cde8e93958fe20813f71a2f"
server_key_iv: "7ef3f5bd06b8636e14c1544031e86aad"
server_key_version: "encryptionkey@0"
I20260808 02:41:31.914261 24964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:31.935684 24964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:31.941524 24964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:31.941888 24964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:31.943405 24964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:31.945089 24964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:31.945218 24964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:31.945390 24964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:31.945467 24964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:31.986562 24964 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:43309
I20260808 02:41:31.986639 25096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:43309 every 8 connection(s)
I20260808 02:41:31.988229 24964 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:41:31.988932 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 24964
I20260808 02:41:31.989215 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:41:31.990201 10321 external_mini_cluster.cc:1428] Setting key 1750361f36f4a4b9bfa5c82239dd3005
Aug 08 02:41:32 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156891, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:32.016734 25099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:31.991472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:43229 (local address 127.10.20.126:44987)
0808 02:41:31.992003 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:31.992009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:31.993315 (+ 1306us) server_negotiation.cc:407] Connection header received
0808 02:41:31.995718 (+ 2403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:31.995728 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:31.995837 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:31.996052 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:31.998202 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:31.999464 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.001469 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:32.002357 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.002562 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:32.008094 (+ 5532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:32.008105 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:32.008113 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:32.008170 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:32.012418 (+ 4248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:32.013496 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:32.013505 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:32.013511 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:32.013703 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:32.014304 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:32.014312 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:32.014319 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:32.014810 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:32.014985 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:32.015885 (+ 900us) server_negotiation.cc:299] Negotiation successful
0808 02:41:32.016197 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":269,"threads_started":1}
I20260808 02:41:32.018050 25100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:31.992161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:43229)
0808 02:41:31.993114 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:31.993173 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:31.995330 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:31.996338 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:31.996348 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:31.997270 (+ 922us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:31.997932 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:31.997953 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:31.999688 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:31.999692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:32.001150 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:32.001167 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:32.002820 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.002830 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:32.003199 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:32.004141 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:32.004183 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:32.007721 (+ 3538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:32.012684 (+ 4963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:32.012694 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:32.012718 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:32.013311 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:32.013908 (+ 597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:32.013913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:32.013915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:32.014164 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:32.015030 (+ 866us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:32.015038 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:32.015448 (+ 410us) client_negotiation.cc:769] Sending connection context
0808 02:41:32.015730 (+ 282us) client_negotiation.cc:240] Negotiation successful
0808 02:41:32.016635 (+ 905us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":392,"threads_started":1}
I20260808 02:41:32.020576 25097 heartbeater.cc:347] Connected to a master server at 127.10.20.126:44987
I20260808 02:41:32.020980 25097 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:32.021924 25097 heartbeater.cc:511] Master 127.10.20.126:44987 requested a full tablet report, sending...
I20260808 02:41:32.024544 24903 ts_manager.cc:194] Registered new tserver with Master: f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65:43309)
I20260808 02:41:32.026141 24903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:43229
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:41:32.076481 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:44987
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:32.457630 25103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:32.457969 25103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:32.458087 25103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:32.467417 25103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:32.467586 25103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:32.467722 25103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:41:32.479960 25103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:32.481588 25103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:32.483218 25103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:32.499183 25109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:32.499284 25110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:32.499809 25113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:32.501173 25103 server_base.cc:1034] running on GCE node
I20260808 02:41:32.502064 25103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:32.503288 25103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:32.504535 25103 hybrid_clock.cc:648] HybridClock initialized: now 1786156892504459 us; error 70 us; skew 500 ppm
I20260808 02:41:32.504874 25103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:32 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156892, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:32.508981 25103 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:41:32.511094 25103 webserver.cc:460] Webserver started at http://127.10.20.66:38677/ using document root <none> and password file <none>
I20260808 02:41:32.511860 25103 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:32.511979 25103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:32.512257 25103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:32.515592 25103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "0646f212391d42f4a18281c8eb483036"
format_stamp: "Formatted at 2026-08-08 02:41:32 on dist-test-slave-8tdl"
server_key: "3e313c143bff8d7c0c11cb85b8c29eb6"
server_key_iv: "b1ae020533d636da2e7f48f1f0286aeb"
server_key_version: "encryptionkey@0"
I20260808 02:41:32.516440 25103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "0646f212391d42f4a18281c8eb483036"
format_stamp: "Formatted at 2026-08-08 02:41:32 on dist-test-slave-8tdl"
server_key: "3e313c143bff8d7c0c11cb85b8c29eb6"
server_key_iv: "b1ae020533d636da2e7f48f1f0286aeb"
server_key_version: "encryptionkey@0"
I20260808 02:41:32.523008 25103 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 02:41:32.527089 25120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:32.528715 25103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:41:32.528923 25103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "0646f212391d42f4a18281c8eb483036"
format_stamp: "Formatted at 2026-08-08 02:41:32 on dist-test-slave-8tdl"
server_key: "3e313c143bff8d7c0c11cb85b8c29eb6"
server_key_iv: "b1ae020533d636da2e7f48f1f0286aeb"
server_key_version: "encryptionkey@0"
I20260808 02:41:32.529162 25103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:32.543746 25103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:32.548610 25103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:32.548972 25103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:32.550034 25103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:32.551690 25103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:32.551808 25103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:32.551972 25103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:32.552053 25103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:32.591604 25103 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36001
I20260808 02:41:32.591643 25235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36001 every 8 connection(s)
I20260808 02:41:32.593047 25103 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:41:32.603323 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25103
I20260808 02:41:32.603544 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:41:32.604056 10321 external_mini_cluster.cc:1428] Setting key 141b163e11d5a756263be1af92e8b49c
Aug 08 02:41:32 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156892, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:32.617019 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:32.596108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:48843 (local address 127.10.20.126:44987)
0808 02:41:32.596666 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:32.596671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:32.597522 (+ 851us) server_negotiation.cc:407] Connection header received
0808 02:41:32.599665 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:32.599671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:32.599780 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:32.599913 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:32.601726 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:32.602496 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.604514 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:32.605029 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.605187 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:32.609824 (+ 4637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:32.609830 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:32.609834 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:32.609878 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:32.613030 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:32.614039 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:32.614044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:32.614047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:32.614195 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:32.614804 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:32.614809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:32.614812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:32.615170 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:32.615403 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:32.616269 (+ 866us) server_negotiation.cc:299] Negotiation successful
0808 02:41:32.616584 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":295,"threads_started":1}
I20260808 02:41:32.618198 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:32.596490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:48843)
0808 02:41:32.597297 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:32.597347 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:32.599307 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:32.600210 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:32.600219 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:32.600830 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:32.601500 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:32.601521 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:32.602757 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.602762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:32.604325 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:32.604341 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:32.605305 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:32.605313 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:32.605587 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:32.606399 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:32.606426 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:32.609484 (+ 3058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:32.613261 (+ 3777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:32.613274 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:32.613305 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:32.613859 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:32.614334 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:32.614339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:32.614344 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:32.614596 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:32.615381 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:32.615391 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:32.615820 (+ 429us) client_negotiation.cc:769] Sending connection context
0808 02:41:32.616139 (+ 319us) client_negotiation.cc:240] Negotiation successful
0808 02:41:32.616802 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":374,"threads_started":1}
I20260808 02:41:32.620364 25236 heartbeater.cc:347] Connected to a master server at 127.10.20.126:44987
I20260808 02:41:32.620790 25236 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:32.621850 25236 heartbeater.cc:511] Master 127.10.20.126:44987 requested a full tablet report, sending...
I20260808 02:41:32.623816 24903 ts_manager.cc:194] Registered new tserver with Master: 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001)
I20260808 02:41:32.624854 24903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:48843
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:41:32.684084 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:44987
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:33.030314 25097 heartbeater.cc:503] Master 127.10.20.126:44987 was elected leader, sending a full tablet report...
W20260808 02:41:33.064847 25242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:33.065184 25242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:33.065364 25242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:33.073028 25242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:33.073318 25242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:33.073515 25242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:41:33.084147 25242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:33.085661 25242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:33.087256 25242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:33.102819 25247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:33.102762 25248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:33.102802 25250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:33.108929 25242 server_base.cc:1034] running on GCE node
I20260808 02:41:33.109787 25242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:33.111094 25242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:33.112363 25242 hybrid_clock.cc:648] HybridClock initialized: now 1786156893112297 us; error 77 us; skew 500 ppm
I20260808 02:41:33.112766 25242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:33 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156893, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:33.116626 25242 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:41:33.119268 25242 webserver.cc:460] Webserver started at http://127.10.20.67:45817/ using document root <none> and password file <none>
I20260808 02:41:33.120266 25242 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:33.120450 25242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:33.120806 25242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:33.124279 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "9bbe70f5592a417894737aaa9ca5ea75"
format_stamp: "Formatted at 2026-08-08 02:41:33 on dist-test-slave-8tdl"
server_key: "31c44a321fafca38d8b4c2852a524bd7"
server_key_iv: "59da7e5433e82ed225d5007f4bccd31c"
server_key_version: "encryptionkey@0"
I20260808 02:41:33.125218 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "9bbe70f5592a417894737aaa9ca5ea75"
format_stamp: "Formatted at 2026-08-08 02:41:33 on dist-test-slave-8tdl"
server_key: "31c44a321fafca38d8b4c2852a524bd7"
server_key_iv: "59da7e5433e82ed225d5007f4bccd31c"
server_key_version: "encryptionkey@0"
I20260808 02:41:33.131592 25242 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 02:41:33.136094 25258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:33.137703 25242 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260808 02:41:33.137931 25242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9bbe70f5592a417894737aaa9ca5ea75"
format_stamp: "Formatted at 2026-08-08 02:41:33 on dist-test-slave-8tdl"
server_key: "31c44a321fafca38d8b4c2852a524bd7"
server_key_iv: "59da7e5433e82ed225d5007f4bccd31c"
server_key_version: "encryptionkey@0"
I20260808 02:41:33.138177 25242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:33.153147 25242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:33.158448 25242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:33.158818 25242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:33.159957 25242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:33.161605 25242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:33.161697 25242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:33.161793 25242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:33.161844 25242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:33.203526 25242 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:35541
I20260808 02:41:33.203565 25372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:35541 every 8 connection(s)
I20260808 02:41:33.205137 25242 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:41:33.211529 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25242
I20260808 02:41:33.211761 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:41:33.212430 10321 external_mini_cluster.cc:1428] Setting key 1bee60183585e012f29ee8af007861fd
Aug 08 02:41:33 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156893, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:33.231806 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.208426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:34551 (local address 127.10.20.126:44987)
0808 02:41:33.209127 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.209133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.210026 (+ 893us) server_negotiation.cc:407] Connection header received
0808 02:41:33.212316 (+ 2290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.212323 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.212460 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.212600 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:33.214789 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.215868 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.217863 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.218431 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.218554 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.223099 (+ 4545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:33.223108 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:33.223113 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:33.223172 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:33.227695 (+ 4523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.228936 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.228942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.228947 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.229123 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.229744 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.229748 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.229750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.230084 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:33.230222 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.231292 (+ 1070us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.231505 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":367,"threads_started":1}
I20260808 02:41:33.232909 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.208822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:34551)
0808 02:41:33.209770 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.209822 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:33.211979 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:33.212894 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:33.212905 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:33.213689 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:33.214501 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.214551 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.216076 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.216083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.217679 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.217696 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.218787 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.218799 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.219083 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.219933 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:33.219963 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:33.222771 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:33.227936 (+ 5165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:33.227950 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:33.227973 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:33.228775 (+ 802us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:33.229275 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:33.229282 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:33.229286 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:33.229587 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:33.230227 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:33.230236 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:33.230807 (+ 571us) client_negotiation.cc:769] Sending connection context
0808 02:41:33.231106 (+ 299us) client_negotiation.cc:240] Negotiation successful
0808 02:41:33.231585 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":338,"threads_started":1}
I20260808 02:41:33.234947 25373 heartbeater.cc:347] Connected to a master server at 127.10.20.126:44987
I20260808 02:41:33.235422 25373 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:33.236364 25373 heartbeater.cc:511] Master 127.10.20.126:44987 requested a full tablet report, sending...
I20260808 02:41:33.238283 24903 ts_manager.cc:194] Registered new tserver with Master: 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67:35541)
I20260808 02:41:33.239372 24903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:34551
I20260808 02:41:33.243537 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:41:33.266662 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.249507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33806 (local address 127.10.20.126:44987)
0808 02:41:33.249921 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.249931 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.250803 (+ 872us) server_negotiation.cc:407] Connection header received
0808 02:41:33.251162 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.251167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.251246 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.251364 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:33.253081 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.253896 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.255691 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.256251 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.256499 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.259849 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:33.259855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:33.259859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:33.259909 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:33.263335 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.264323 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.264328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.264331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.264492 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.264967 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.264971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.264973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.265350 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:33.265643 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.266040 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.266313 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:41:33.272332 24903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:41:33.280962 24903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:41:33.321502 25387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.297150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36836)
0808 02:41:33.308786 (+ 11636us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.308835 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:33.309099 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:33.310293 (+ 1194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:33.310302 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:33.310334 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:33.310873 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.310890 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.313908 (+ 3018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.313918 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.317123 (+ 3205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.317150 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.320272 (+ 3122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.320280 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.320503 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.320563 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 02:41:33.320726 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 02:41:33.320989 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11350,"thread_start_us":11188,"threads_started":1}
I20260808 02:41:33.322372 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.297417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36836 (local address 127.10.20.65:43309)
0808 02:41:33.308215 (+ 10798us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.308230 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.309227 (+ 997us) server_negotiation.cc:407] Connection header received
0808 02:41:33.309359 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.309373 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.309688 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.309912 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:33.311188 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.313626 (+ 2438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.317417 (+ 3791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.319617 (+ 2200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.319782 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.320084 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.320838 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.321081 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10582,"thread_start_us":10376,"threads_started":1}
I20260808 02:41:33.327095 25032 tablet_service.cc:1467] Processing CreateTablet for tablet 2040a7df3ae34e27b6c66efa9056ca2c (DEFAULT_TABLE table=test-table [id=e7b185a1122e447099592d355373ecde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:33.328735 25392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.303365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43406 (local address 127.10.20.67:35541)
0808 02:41:33.317754 (+ 14389us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.317764 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.319935 (+ 2171us) server_negotiation.cc:407] Connection header received
0808 02:41:33.320345 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.320352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.320568 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.320816 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:33.321968 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.323731 (+ 1763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.326298 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.327375 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.327541 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.327791 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.328074 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.328265 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14168,"thread_start_us":13962,"threads_started":1}
I20260808 02:41:33.328955 25391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.297639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36001 (local address 127.0.0.1:60876)
0808 02:41:33.318810 (+ 21171us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.318835 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:33.319070 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:33.320844 (+ 1774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:33.320848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:33.320877 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:33.321309 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.321322 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.323500 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.323505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.325843 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.325861 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.328044 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.328051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.328229 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.328261 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 02:41:33.328357 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 02:41:33.328539 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20986,"mutex_wait_us":1,"thread_start_us":21821,"threads_started":1}
I20260808 02:41:33.329200 25032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2040a7df3ae34e27b6c66efa9056ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:33.330016 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.302420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:35541 (local address 127.0.0.1:43406)
0808 02:41:33.319791 (+ 17371us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.319810 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:33.320067 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:33.321167 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:33.321173 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:33.321213 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:33.321714 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.321730 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.323909 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.323914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.326120 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.326131 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.327609 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.327615 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.327793 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.327839 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:41:33.329495 (+ 1656us) client_negotiation.cc:240] Negotiation successful
0808 02:41:33.329659 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17231,"thread_start_us":16002,"threads_started":1}
I20260808 02:41:33.330571 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.298036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60876 (local address 127.10.20.66:36001)
0808 02:41:33.320140 (+ 22104us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.320149 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.320176 (+ 27us) server_negotiation.cc:407] Connection header received
0808 02:41:33.320286 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.320295 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.320605 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.321550 (+ 945us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:33.321813 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.323357 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.326065 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.327729 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.327980 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.328178 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.328444 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.328643 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21943,"thread_start_us":21798,"threads_started":1}
I20260808 02:41:33.334225 25307 tablet_service.cc:1467] Processing CreateTablet for tablet 2040a7df3ae34e27b6c66efa9056ca2c (DEFAULT_TABLE table=test-table [id=e7b185a1122e447099592d355373ecde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:33.334225 25169 tablet_service.cc:1467] Processing CreateTablet for tablet 2040a7df3ae34e27b6c66efa9056ca2c (DEFAULT_TABLE table=test-table [id=e7b185a1122e447099592d355373ecde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:33.335986 25169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2040a7df3ae34e27b6c66efa9056ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:33.335986 25307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2040a7df3ae34e27b6c66efa9056ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:33.344491 25393 tablet_bootstrap.cc:492] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Bootstrap starting.
I20260808 02:41:33.350580 25393 tablet_bootstrap.cc:654] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:33.352015 25393 log.cc:824] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:33.353319 25396 tablet_bootstrap.cc:492] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Bootstrap starting.
I20260808 02:41:33.354458 25394 tablet_bootstrap.cc:492] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Bootstrap starting.
I20260808 02:41:33.358209 25396 tablet_bootstrap.cc:654] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:33.359704 25394 tablet_bootstrap.cc:654] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:33.360170 25396 log.cc:824] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:33.361093 25394 log.cc:824] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:33.362177 25393 tablet_bootstrap.cc:492] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: No bootstrap required, opened a new log
I20260808 02:41:33.362500 25393 ts_tablet_manager.cc:1397] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.005s
I20260808 02:41:33.363588 25396 tablet_bootstrap.cc:492] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: No bootstrap required, opened a new log
I20260808 02:41:33.363941 25396 ts_tablet_manager.cc:1397] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 02:41:33.364449 25394 tablet_bootstrap.cc:492] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: No bootstrap required, opened a new log
I20260808 02:41:33.364760 25394 ts_tablet_manager.cc:1397] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 02:41:33.370662 25393 raft_consensus.cc:348] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.371236 25393 raft_consensus.cc:374] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:33.371382 25393 raft_consensus.cc:729] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e27949598a4fcd8770f20d76b7f620, State: Initialized, Role: FOLLOWER
I20260808 02:41:33.372114 25393 consensus_queue.cc:260] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.374514 25393 ts_tablet_manager.cc:1428] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Time spent starting tablet: real 0.012s user 0.011s sys 0.004s
I20260808 02:41:33.376327 25396 raft_consensus.cc:348] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.376916 25396 raft_consensus.cc:374] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:33.376672 25394 raft_consensus.cc:348] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.377029 25396 raft_consensus.cc:729] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646f212391d42f4a18281c8eb483036, State: Initialized, Role: FOLLOWER
I20260808 02:41:33.377133 25394 raft_consensus.cc:374] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:33.377229 25394 raft_consensus.cc:729] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe70f5592a417894737aaa9ca5ea75, State: Initialized, Role: FOLLOWER
I20260808 02:41:33.377818 25394 consensus_queue.cc:260] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.377802 25396 consensus_queue.cc:260] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.379794 25236 heartbeater.cc:503] Master 127.10.20.126:44987 was elected leader, sending a full tablet report...
I20260808 02:41:33.379839 25373 heartbeater.cc:503] Master 127.10.20.126:44987 was elected leader, sending a full tablet report...
I20260808 02:41:33.380170 25396 ts_tablet_manager.cc:1428] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260808 02:41:33.380244 25394 ts_tablet_manager.cc:1428] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
W20260808 02:41:33.457209 25374 tablet.cc:2369] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:33.487787 25403 raft_consensus.cc:482] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:41:33.488221 25403 raft_consensus.cc:504] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.490324 25403 leader_election.cc:288] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65:43309), 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001)
W20260808 02:41:33.491830 25098 tablet.cc:2369] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:33.497406 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.491004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:54671 (local address 127.10.20.66:36001)
0808 02:41:33.491262 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.491271 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.491305 (+ 34us) server_negotiation.cc:407] Connection header received
0808 02:41:33.491393 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.491398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.491458 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.491591 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:33.492145 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.493226 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.495151 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.496190 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.496395 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.496484 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.496918 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.497063 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 02:41:33.497406 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.490843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36001 (local address 127.10.20.67:54671)
0808 02:41:33.491055 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.491077 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:33.491256 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:33.491614 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:33.491623 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:33.491652 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:33.491910 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.491927 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.493401 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.493404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.494974 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.494988 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.496577 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.496583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.496749 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.496774 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:41:33.496889 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 02:41:33.497050 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 02:41:33.498663 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.491121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:35553 (local address 127.10.20.65:43309)
0808 02:41:33.491369 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.491376 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.492376 (+ 1000us) server_negotiation.cc:407] Connection header received
0808 02:41:33.492547 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.492552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.492634 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.492743 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:33.493365 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.494108 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.496604 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.497504 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.497697 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.497763 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.498350 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.498479 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:41:33.498898 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.490859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.10.20.67:35553)
0808 02:41:33.492255 (+ 1396us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.492273 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:33.492403 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:33.492778 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:33.492782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:33.492807 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:33.493177 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.493190 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.494293 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.494299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.496331 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:33.496355 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.497912 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.497917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:33.498105 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.498151 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 02:41:33.498276 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 02:41:33.498440 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1258,"mutex_wait_us":500,"thread_start_us":505,"threads_started":1}
I20260808 02:41:33.498611 25189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2040a7df3ae34e27b6c66efa9056ca2c" candidate_uuid: "9bbe70f5592a417894737aaa9ca5ea75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646f212391d42f4a18281c8eb483036" is_pre_election: true
I20260808 02:41:33.499365 25189 raft_consensus.cc:2454] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe70f5592a417894737aaa9ca5ea75 in term 0.
I20260808 02:41:33.500312 25263 leader_election.cc:302] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646f212391d42f4a18281c8eb483036, 9bbe70f5592a417894737aaa9ca5ea75; no voters:
I20260808 02:41:33.500298 25052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2040a7df3ae34e27b6c66efa9056ca2c" candidate_uuid: "9bbe70f5592a417894737aaa9ca5ea75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e27949598a4fcd8770f20d76b7f620" is_pre_election: true
I20260808 02:41:33.500734 25403 raft_consensus.cc:2781] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:41:33.500958 25403 raft_consensus.cc:482] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:41:33.501103 25403 raft_consensus.cc:3037] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:33.501020 25052 raft_consensus.cc:2454] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe70f5592a417894737aaa9ca5ea75 in term 0.
I20260808 02:41:33.504066 25403 raft_consensus.cc:504] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.504812 25403 leader_election.cc:288] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [CANDIDATE]: Term 1 election: Requested vote from peers f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65:43309), 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001)
I20260808 02:41:33.505474 25052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2040a7df3ae34e27b6c66efa9056ca2c" candidate_uuid: "9bbe70f5592a417894737aaa9ca5ea75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e27949598a4fcd8770f20d76b7f620"
I20260808 02:41:33.505589 25189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2040a7df3ae34e27b6c66efa9056ca2c" candidate_uuid: "9bbe70f5592a417894737aaa9ca5ea75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646f212391d42f4a18281c8eb483036"
I20260808 02:41:33.505712 25052 raft_consensus.cc:3037] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:33.505890 25189 raft_consensus.cc:3037] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:33.508239 25052 raft_consensus.cc:2454] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe70f5592a417894737aaa9ca5ea75 in term 1.
I20260808 02:41:33.508460 25189 raft_consensus.cc:2454] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe70f5592a417894737aaa9ca5ea75 in term 1.
I20260808 02:41:33.508910 25261 leader_election.cc:302] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe70f5592a417894737aaa9ca5ea75, f6e27949598a4fcd8770f20d76b7f620; no voters:
I20260808 02:41:33.509325 25403 raft_consensus.cc:2781] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:33.509820 25403 raft_consensus.cc:686] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe70f5592a417894737aaa9ca5ea75, State: Running, Role: LEADER
I20260808 02:41:33.510361 25403 consensus_queue.cc:237] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } }
I20260808 02:41:33.515614 24903 catalog_manager.cc:5495] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "9bbe70f5592a417894737aaa9ca5ea75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } health_report { overall_health: HEALTHY } } }
I20260808 02:41:33.557009 25392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.551108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.10.20.67:35541)
0808 02:41:33.551313 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.551318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.551335 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:41:33.551431 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.551435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.551540 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.551673 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:41:33.552065 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.552834 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.554331 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.554918 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.555064 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.555727 (+ 663us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:41:33.556296 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:41:33.556423 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.556601 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.556685 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 02:41:33.567027 25189 raft_consensus.cc:1261] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe70f5592a417894737aaa9ca5ea75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:33.567071 25052 raft_consensus.cc:1261] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe70f5592a417894737aaa9ca5ea75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:33.568187 25405 consensus_queue.cc:1035] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:33.568608 25403 consensus_queue.cc:1035] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:33.583442 25408 mvcc.cc:205] Tried to move back new op lower bound from 7316098636038021120 to 7316098635822845952. Current Snapshot: MvccSnapshot[applied={T|T < 7316098636038021120}]
I20260808 02:41:33.602267 24903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:33.602607 24903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:33.607395 24903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Sending DeleteTablet for 3 replicas of tablet 2040a7df3ae34e27b6c66efa9056ca2c
I20260808 02:41:33.608917 25032 tablet_service.cc:1514] Processing DeleteTablet for tablet 2040a7df3ae34e27b6c66efa9056ca2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:33 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:36836
I20260808 02:41:33.609364 25307 tablet_service.cc:1514] Processing DeleteTablet for tablet 2040a7df3ae34e27b6c66efa9056ca2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:33 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:43406
I20260808 02:41:33.609860 25169 tablet_service.cc:1514] Processing DeleteTablet for tablet 2040a7df3ae34e27b6c66efa9056ca2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:33 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:60876
I20260808 02:41:33.610173 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24964
I20260808 02:41:33.611207 25417 tablet_replica.cc:330] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: stopping tablet replica
I20260808 02:41:33.611755 25417 raft_consensus.cc:2229] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:33.612388 25417 raft_consensus.cc:2258] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:33.620314 25417 ts_tablet_manager.cc:1905] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:33.624178 25419 tablet_replica.cc:330] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: stopping tablet replica
I20260808 02:41:33.624873 25419 raft_consensus.cc:2229] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:33.625617 25419 raft_consensus.cc:2258] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:33.626649 25418 tablet_replica.cc:330] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: stopping tablet replica
I20260808 02:41:33.627590 25418 raft_consensus.cc:2229] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:41:33.628482 25418 raft_consensus.cc:2258] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:33.631033 25419 ts_tablet_manager.cc:1905] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:33.631035 25418 ts_tablet_manager.cc:1905] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 02:41:33 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:41:33.637127 25417 ts_tablet_manager.cc:1918] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:33.640381 25418 ts_tablet_manager.cc:1918] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:33.640759 25418 log.cc:1196] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/2040a7df3ae34e27b6c66efa9056ca2c
I20260808 02:41:33.641634 25418 ts_tablet_manager.cc:1939] T 2040a7df3ae34e27b6c66efa9056ca2c P 9bbe70f5592a417894737aaa9ca5ea75: Deleting consensus metadata
I20260808 02:41:33.642752 25417 log.cc:1196] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/2040a7df3ae34e27b6c66efa9056ca2c
I20260808 02:41:33.643239 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.611127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36850 (local address 127.10.20.65:43309)
0808 02:41:33.611342 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.611350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.618158 (+ 6808us) server_negotiation.cc:407] Connection header received
0808 02:41:33.618586 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.618593 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.618723 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.618822 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:33.621278 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.622719 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.625232 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.626010 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.626169 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.633261 (+ 7092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:33.633290 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:33.633312 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:33.633414 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:33.638736 (+ 5322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.640034 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.640046 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.640050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.640263 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.640821 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.640827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.640831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.641367 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:33.641688 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.642441 (+ 753us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.642750 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:41:33.644188 24886 catalog_manager.cc:4841] TS 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67:35541): tablet 2040a7df3ae34e27b6c66efa9056ca2c (table test-table [id=e7b185a1122e447099592d355373ecde]) successfully deleted
I20260808 02:41:33.644462 25417 ts_tablet_manager.cc:1939] T 2040a7df3ae34e27b6c66efa9056ca2c P f6e27949598a4fcd8770f20d76b7f620: Deleting consensus metadata
I20260808 02:41:33.645449 25092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:33.645855 25419 ts_tablet_manager.cc:1918] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:33.646109 25419 log.cc:1196] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/2040a7df3ae34e27b6c66efa9056ca2c
I20260808 02:41:33.646804 25419 ts_tablet_manager.cc:1939] T 2040a7df3ae34e27b6c66efa9056ca2c P 0646f212391d42f4a18281c8eb483036: Deleting consensus metadata
I20260808 02:41:33.648926 24889 catalog_manager.cc:4841] TS 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001): tablet 2040a7df3ae34e27b6c66efa9056ca2c (table test-table [id=e7b185a1122e447099592d355373ecde]) successfully deleted
I20260808 02:41:33.751765 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24964
I20260808 02:41:33.775205 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 25103
W20260808 02:41:33.775122 24887 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:43309 (error 108)
I20260808 02:41:33.778108 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.777525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36864)
0808 02:41:33.777745 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.777895 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 02:41:33.778411 24887 catalog_manager.cc:4584] TS f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65:43309): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2040a7df3ae34e27b6c66efa9056ca2c: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Aug 08 02:41:33 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:41:33.794752 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.776210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60888 (local address 127.10.20.66:36001)
0808 02:41:33.776451 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.776461 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.776489 (+ 28us) server_negotiation.cc:407] Connection header received
0808 02:41:33.776649 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.776658 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.776779 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.776901 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:33.778798 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.779761 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.781437 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.781897 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.782067 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.787945 (+ 5878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:33.787963 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:33.787981 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:33.788029 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:33.791561 (+ 3532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.792415 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.792424 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.792427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.792582 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.792985 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.792990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.792993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.793397 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:33.793714 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.794046 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.794308 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:41:33.795444 25231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:33.832291 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.831672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36866)
0808 02:41:33.831959 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.832098 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 02:41:33.833693 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.833190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36870)
0808 02:41:33.833369 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.833522 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 02:41:33.895830 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.894612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36880)
0808 02:41:33.895474 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.895602 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480}
I20260808 02:41:33.896432 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 25103
I20260808 02:41:33.904503 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.903735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36884)
0808 02:41:33.904198 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.904291 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349}
I20260808 02:41:33.921841 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 25242
Aug 08 02:41:33 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:41:33.942271 25392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.922787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43430 (local address 127.10.20.67:35541)
0808 02:41:33.923028 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:33.923035 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:33.923057 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:41:33.923204 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:33.923209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:33.923284 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:33.923414 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:33.924871 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.925674 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.927300 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:33.927797 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:33.927975 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:33.933636 (+ 5661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:33.933655 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:33.933671 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:33.933730 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:33.937547 (+ 3817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.938845 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.938854 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.939067 (+ 213us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.939343 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:33.940007 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:33.940013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:33.940015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:33.940547 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:33.940989 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:33.941504 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 02:41:33.941774 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:41:33.943351 25368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:33.985565 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.984876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36886)
0808 02:41:33.985177 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.985300 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 02:41:33.987040 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:33.986454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36894)
0808 02:41:33.986749 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:33.986876 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 02:41:34.079700 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 25242
I20260808 02:41:34.104372 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 24870
I20260808 02:41:34.105788 24933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:34.222916 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:34.222312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:36902)
0808 02:41:34.222488 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:34.222644 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:43309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 02:41:34.223383 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 24870
I20260808 02:41:34.251143 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44987
--webserver_interface=127.10.20.126
--webserver_port=33271
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:44987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:34.641824 25426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:34.642235 25426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:34.642356 25426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:34.651814 25426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:34.651978 25426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:34.652037 25426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:34.652118 25426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:34.652170 25426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:34.664224 25426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:44987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=33271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:34.665696 25426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:34.667309 25426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:34.699551 25433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:34.699564 25432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:34.699566 25435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:34.700645 25426 server_base.cc:1034] running on GCE node
I20260808 02:41:34.701711 25426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:34.703871 25426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:34.705154 25426 hybrid_clock.cc:648] HybridClock initialized: now 1786156894705089 us; error 53 us; skew 500 ppm
I20260808 02:41:34.705732 25426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:34 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156894, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:34.710410 25426 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:34.712845 25426 webserver.cc:460] Webserver started at http://127.10.20.126:33271/ using document root <none> and password file <none>
I20260808 02:41:34.713860 25426 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:34.714066 25426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:34.722268 25426 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 02:41:34.726330 25443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:34.728366 25426 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:34.728607 25426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "80c28a2ea0a741d9be542206f29be7d6"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "f02e26d98d034de34c53b0363dd21faf"
server_key_iv: "010578436bb13907763f1170866175d1"
server_key_version: "encryptionkey@0"
I20260808 02:41:34.729897 25426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:34.763412 25426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:34.769137 25426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:34.769500 25426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:34.794320 25426 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:44987
I20260808 02:41:34.794299 25496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:44987 every 8 connection(s)
I20260808 02:41:34.796401 25426 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:34.800164 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25426
I20260808 02:41:34.801364 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:43309
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:44987
--webserver_port=38161
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:34.807430 25498 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:41:34.813618 25498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap starting.
I20260808 02:41:34.836829 25498 log.cc:824] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:34.852306 25498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:41:34.852973 25498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap complete.
I20260808 02:41:34.864283 25498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:34.865338 25498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80c28a2ea0a741d9be542206f29be7d6, State: Initialized, Role: FOLLOWER
I20260808 02:41:34.866079 25498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:34.866379 25498 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:34.866541 25498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:34.866824 25498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:41:34.871848 25498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:34.872495 25498 leader_election.cc:302] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80c28a2ea0a741d9be542206f29be7d6; no voters:
I20260808 02:41:34.873255 25498 leader_election.cc:288] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:41:34.873423 25502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:41:34.874765 25502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 LEADER]: Becoming Leader. State: Replica: 80c28a2ea0a741d9be542206f29be7d6, State: Running, Role: LEADER
I20260808 02:41:34.875542 25502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:34.876017 25498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:34.878605 25504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80c28a2ea0a741d9be542206f29be7d6. Latest consensus state: current_term: 2 leader_uuid: "80c28a2ea0a741d9be542206f29be7d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } } }
I20260808 02:41:34.878790 25503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "80c28a2ea0a741d9be542206f29be7d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } } }
I20260808 02:41:34.879143 25504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:34.879218 25503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:34.880633 25509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:34.891499 25509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:34.893203 25509 catalog_manager.cc:1259] Loaded cluster ID: 07bf9f045c854c19b5aa22b3797cb48e
I20260808 02:41:34.893391 25509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:34.896993 25509 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 02:41:34.916049 25509 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 02:41:34.935626 25509 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:34.938102 25509 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Loaded TSK: 0
I20260808 02:41:34.939998 25509 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:41:35.219496 25500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:35.219885 25500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:35.220063 25500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:35.229480 25500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:35.229677 25500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:35.229869 25500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:41:35.240818 25500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:43309
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=38161
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:35.242349 25500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:35.243862 25500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:35.259680 25526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:35.260438 25525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:35.261974 25528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:35.262281 25500 server_base.cc:1034] running on GCE node
I20260808 02:41:35.263214 25500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:35.264488 25500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:35.265820 25500 hybrid_clock.cc:648] HybridClock initialized: now 1786156895265759 us; error 57 us; skew 500 ppm
I20260808 02:41:35.266250 25500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:35 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:35.270931 25500 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:41:35.273018 25500 webserver.cc:460] Webserver started at http://127.10.20.65:38161/ using document root <none> and password file <none>
I20260808 02:41:35.273954 25500 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:35.274201 25500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:35.281466 25500 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:41:35.285383 25535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:35.287429 25500 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:35.287694 25500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "f6e27949598a4fcd8770f20d76b7f620"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "3d7a1c351cde8e93958fe20813f71a2f"
server_key_iv: "7ef3f5bd06b8636e14c1544031e86aad"
server_key_version: "encryptionkey@0"
I20260808 02:41:35.288810 25500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:35.311293 25500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:35.316622 25500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:35.316983 25500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:35.318372 25500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:35.320237 25500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:35.320365 25500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:35.320568 25500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:35.320658 25500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:35.362097 25500 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:43309
I20260808 02:41:35.362201 25652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:43309 every 8 connection(s)
I20260808 02:41:35.363996 25500 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:41:35.371383 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25500
I20260808 02:41:35.372332 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:36001
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:44987
--webserver_port=38677
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:41:35 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:35.396598 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:35.367800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:57731 (local address 127.10.20.126:44987)
0808 02:41:35.368486 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:35.368499 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:35.369433 (+ 934us) server_negotiation.cc:407] Connection header received
0808 02:41:35.372351 (+ 2918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:35.372377 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:35.373034 (+ 657us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:35.373545 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:35.375542 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.377942 (+ 2400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.380480 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.381806 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.382068 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:35.386901 (+ 4833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:35.386911 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:35.386927 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:35.386974 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:35.390656 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:35.391798 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:35.391806 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:35.391813 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:35.392033 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:35.392586 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:35.392591 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:35.392593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:35.393274 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:35.393548 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:35.394567 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0808 02:41:35.395078 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":285,"threads_started":1}
I20260808 02:41:35.396602 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:35.368114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:57731)
0808 02:41:35.369162 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:35.369222 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:35.371475 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:35.373887 (+ 2412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:35.373896 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:35.374490 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:35.375226 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:35.375246 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.378284 (+ 3038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.378290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:35.380242 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:35.380263 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.382184 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.382191 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:35.382493 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:35.383492 (+ 999us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:35.383519 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:35.386448 (+ 2929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:35.390980 (+ 4532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:35.390990 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:35.391005 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:35.391578 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:35.392182 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:35.392191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:35.392200 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:35.392419 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:35.393454 (+ 1035us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:35.393464 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:35.393930 (+ 466us) client_negotiation.cc:769] Sending connection context
0808 02:41:35.394276 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 02:41:35.395029 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":448,"threads_started":1}
I20260808 02:41:35.400470 25653 heartbeater.cc:347] Connected to a master server at 127.10.20.126:44987
I20260808 02:41:35.400876 25653 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:35.401847 25653 heartbeater.cc:511] Master 127.10.20.126:44987 requested a full tablet report, sending...
I20260808 02:41:35.404553 25461 ts_manager.cc:194] Registered new tserver with Master: f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65:43309)
I20260808 02:41:35.406138 25461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:57731
W20260808 02:41:35.759168 25657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:35.759497 25657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:35.759661 25657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:35.767865 25657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:35.768014 25657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:35.768213 25657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:41:35.779129 25657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:36001
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=38677
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:35.780653 25657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:35.782203 25657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:35.797674 25662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:35.797638 25663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:35.798592 25665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:35.798945 25657 server_base.cc:1034] running on GCE node
I20260808 02:41:35.799690 25657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:35.800971 25657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:35.802269 25657 hybrid_clock.cc:648] HybridClock initialized: now 1786156895802210 us; error 46 us; skew 500 ppm
I20260808 02:41:35.802635 25657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:35 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:35.806218 25657 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:41:35.808065 25657 webserver.cc:460] Webserver started at http://127.10.20.66:38677/ using document root <none> and password file <none>
I20260808 02:41:35.808853 25657 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:35.809037 25657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:35.815269 25657 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:41:35.818521 25672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:35.820480 25657 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:41:35.820694 25657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "0646f212391d42f4a18281c8eb483036"
format_stamp: "Formatted at 2026-08-08 02:41:32 on dist-test-slave-8tdl"
server_key: "3e313c143bff8d7c0c11cb85b8c29eb6"
server_key_iv: "b1ae020533d636da2e7f48f1f0286aeb"
server_key_version: "encryptionkey@0"
I20260808 02:41:35.821818 25657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:35.845373 25657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:35.850405 25657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:35.850816 25657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:35.851959 25657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:35.853359 25657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:35.853456 25657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:35.853536 25657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:35.853593 25657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:35.892352 25657 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36001
I20260808 02:41:35.892433 25790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36001 every 8 connection(s)
I20260808 02:41:35.894131 25657 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:41:35.902750 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25657
I20260808 02:41:35.903571 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:35541
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:44987
--webserver_port=45817
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:41:35 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:35.919479 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:35.897353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:47001 (local address 127.10.20.126:44987)
0808 02:41:35.897598 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:35.897603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:35.898606 (+ 1003us) server_negotiation.cc:407] Connection header received
0808 02:41:35.900692 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:35.900698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:35.900850 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:35.900987 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:35.902824 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.903968 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.905762 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.906523 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.906718 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:35.911609 (+ 4891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:35.911619 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:35.911626 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:35.911680 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:35.915443 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:35.916667 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:35.916675 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:35.916681 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:35.916856 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:35.917450 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:35.917454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:35.917457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:35.917777 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:35.917958 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:35.918818 (+ 860us) server_negotiation.cc:299] Negotiation successful
0808 02:41:35.919108 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:41:35.920653 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:35.897585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:47001)
0808 02:41:35.898381 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:35.898438 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:35.900351 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:35.901270 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:35.901281 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:35.901878 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:35.902531 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:35.902552 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.904176 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.904180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:35.905555 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:35.905570 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:35.906881 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:35.906886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:35.907207 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:35.908107 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:35.908143 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:35.911269 (+ 3126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:35.915667 (+ 4398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:35.915682 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:35.915708 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:35.916499 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:35.916987 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:35.916994 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:35.917001 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:35.917285 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:35.917930 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:35.917938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:35.918347 (+ 409us) client_negotiation.cc:769] Sending connection context
0808 02:41:35.918644 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 02:41:35.919313 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":351,"threads_started":1}
I20260808 02:41:35.922477 25791 heartbeater.cc:347] Connected to a master server at 127.10.20.126:44987
I20260808 02:41:35.922942 25791 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:35.923972 25791 heartbeater.cc:511] Master 127.10.20.126:44987 requested a full tablet report, sending...
I20260808 02:41:35.926151 25461 ts_manager.cc:194] Registered new tserver with Master: 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001)
I20260808 02:41:35.927646 25461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:47001
W20260808 02:41:36.300396 25795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:36.300704 25795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:36.300803 25795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:36.308516 25795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:36.308648 25795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:36.308766 25795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:41:36.319948 25795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:35541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=45817
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:36.321347 25795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:36.322849 25795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:36.338143 25800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:36.338106 25803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:36.338119 25801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:36.339387 25795 server_base.cc:1034] running on GCE node
I20260808 02:41:36.340094 25795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:36.341282 25795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:36.342554 25795 hybrid_clock.cc:648] HybridClock initialized: now 1786156896342481 us; error 67 us; skew 500 ppm
I20260808 02:41:36.342957 25795 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:36 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:36.346825 25795 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:41:36.348549 25795 webserver.cc:460] Webserver started at http://127.10.20.67:45817/ using document root <none> and password file <none>
I20260808 02:41:36.349321 25795 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:36.349458 25795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:36.355931 25795 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:36.360203 25810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:36.361830 25795 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:41:36.362043 25795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9bbe70f5592a417894737aaa9ca5ea75"
format_stamp: "Formatted at 2026-08-08 02:41:33 on dist-test-slave-8tdl"
server_key: "31c44a321fafca38d8b4c2852a524bd7"
server_key_iv: "59da7e5433e82ed225d5007f4bccd31c"
server_key_version: "encryptionkey@0"
I20260808 02:41:36.363274 25795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:36.390453 25795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:36.395542 25795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:36.395875 25795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:36.397018 25795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:36.398584 25795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:36.398733 25795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:36.398885 25795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:36.398980 25795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:36.410198 25653 heartbeater.cc:503] Master 127.10.20.126:44987 was elected leader, sending a full tablet report...
I20260808 02:41:36.436453 25795 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:35541
I20260808 02:41:36.436560 25925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:35541 every 8 connection(s)
I20260808 02:41:36.438083 25795 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:41:36.438539 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25795
Aug 08 02:41:36 dist-test-slave-8tdl krb5kdc[24857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:36.457744 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.439986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.10.20.126:44987)
0808 02:41:36.440622 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.440631 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.440668 (+ 37us) server_negotiation.cc:407] Connection header received
0808 02:41:36.440741 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.440744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.440806 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.440921 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:36.443436 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.444389 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.446604 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.447174 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.447324 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.450640 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:36.450647 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:36.450650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:36.450746 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:36.454234 (+ 3488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:36.455184 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:36.455191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:36.455195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:36.455362 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:36.455894 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:36.455901 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:36.455905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:36.456270 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:36.456502 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.456951 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.457251 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":385,"threads_started":1}
I20260808 02:41:36.464620 25931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.441215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:52459 (local address 127.10.20.126:44987)
0808 02:41:36.443042 (+ 1827us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.443048 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.443620 (+ 572us) server_negotiation.cc:407] Connection header received
0808 02:41:36.446306 (+ 2686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.446311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.446389 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.446557 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:36.448725 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.449533 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.451935 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.452664 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.452833 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.457219 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:36.457225 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:36.457230 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:36.457271 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:36.460687 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:36.461613 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:36.461619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:36.461624 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:36.461764 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:36.462361 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:36.462366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:36.462368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:36.462670 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:36.462909 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.463735 (+ 826us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.464001 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1629,"thread_start_us":1474,"threads_started":1}
I20260808 02:41:36.465879 25932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.442022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:52459)
0808 02:41:36.443453 (+ 1431us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:36.443509 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:36.445910 (+ 2401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:36.446964 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:36.446976 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:36.447692 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:36.448507 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.448530 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.449725 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.449729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.451717 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.451746 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.452966 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.452976 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.453279 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.454059 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:36.454085 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:36.456846 (+ 2761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:36.460874 (+ 4028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:36.460885 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:36.460914 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:36.461453 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:36.461904 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:36.461909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:36.461913 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:36.462216 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:36.462893 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:36.462902 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:36.463319 (+ 417us) client_negotiation.cc:769] Sending connection context
0808 02:41:36.463628 (+ 309us) client_negotiation.cc:240] Negotiation successful
0808 02:41:36.464394 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1062,"thread_start_us":790,"threads_started":1}
I20260808 02:41:36.467866 25926 heartbeater.cc:347] Connected to a master server at 127.10.20.126:44987
I20260808 02:41:36.468307 25926 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:36.469231 25926 heartbeater.cc:511] Master 127.10.20.126:44987 requested a full tablet report, sending...
I20260808 02:41:36.471500 25461 ts_manager.cc:194] Registered new tserver with Master: 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67:35541)
I20260808 02:41:36.472572 25461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:52459
I20260808 02:41:36.475543 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:41:36.486877 25931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.477474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.10.20.126:44987)
0808 02:41:36.477898 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.477908 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.478578 (+ 670us) server_negotiation.cc:407] Connection header received
0808 02:41:36.478986 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.478991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.479215 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.479427 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:41:36.480120 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.480966 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.483060 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.483839 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.484143 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.485271 (+ 1128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:41:36.485955 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:41:36.486164 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.486332 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.486459 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 02:41:36.488270 25461 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:41:36.497968 25461 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:41:36.534934 25939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.511969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41554 (local address 127.10.20.66:36001)
0808 02:41:36.524045 (+ 12076us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.524059 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.525035 (+ 976us) server_negotiation.cc:407] Connection header received
0808 02:41:36.525168 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.525178 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.525461 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.526971 (+ 1510us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:36.527224 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.528870 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.531757 (+ 2887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.533406 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.533564 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.533786 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.534346 (+ 560us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.534536 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11887,"thread_start_us":11749,"threads_started":1}
I20260808 02:41:36.535079 25938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.511728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36001 (local address 127.0.0.1:41554)
0808 02:41:36.524664 (+ 12936us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:36.524716 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:36.524938 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:36.525756 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:36.525765 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:36.525802 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:36.526701 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.526717 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.529038 (+ 2321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.529045 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.531540 (+ 2495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.531557 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.533800 (+ 2243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.533807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.534051 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.534118 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 02:41:36.534238 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 02:41:36.534521 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12663,"mutex_wait_us":10,"thread_start_us":12484,"threads_started":1}
I20260808 02:41:36.537281 25940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.512139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:43309 (local address 127.0.0.1:47178)
0808 02:41:36.528906 (+ 16767us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:36.528923 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:36.529087 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:36.529725 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:36.529732 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:36.529760 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:36.530237 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.530251 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.532209 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.532214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.534468 (+ 2254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.534483 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.536367 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.536374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.536556 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.536601 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 02:41:36.536699 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 02:41:36.536842 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16634,"mutex_wait_us":44,"thread_start_us":15972,"threads_started":1}
I20260808 02:41:36.537400 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.512870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47178 (local address 127.10.20.65:43309)
0808 02:41:36.527900 (+ 15030us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.527909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.529066 (+ 1157us) server_negotiation.cc:407] Connection header received
0808 02:41:36.529277 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.529285 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.529500 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.529711 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:36.530480 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.532023 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.534668 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.536117 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.536297 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.536543 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.536765 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.537051 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14848,"thread_start_us":14679,"threads_started":1}
I20260808 02:41:36.538641 25943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.512784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58410 (local address 127.10.20.67:35541)
0808 02:41:36.525700 (+ 12916us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.525708 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.528578 (+ 2870us) server_negotiation.cc:407] Connection header received
0808 02:41:36.528921 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.528932 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.529268 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.529484 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:36.530818 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.532553 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.535357 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.536864 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.536977 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.537198 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.538069 (+ 871us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.538259 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12699,"thread_start_us":12527,"threads_started":1}
I20260808 02:41:36.539400 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.511870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:35541 (local address 127.0.0.1:58410)
0808 02:41:36.528433 (+ 16563us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:36.528453 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:36.528700 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:36.529908 (+ 1208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:36.529912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:36.529944 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:36.530560 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.530576 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.532731 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.532736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.535143 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.535163 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.537655 (+ 2492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.537666 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.537838 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.537872 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 02:41:36.537959 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 02:41:36.538094 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16400,"mutex_wait_us":57,"thread_start_us":16738,"threads_started":1}
I20260808 02:41:36.539835 25723 tablet_service.cc:1467] Processing CreateTablet for tablet 616587fb0f8e41a2884bc4967440596a (DEFAULT_TABLE table=test-table [id=51982387ae534868990a0d661652ec9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:36.541424 25723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616587fb0f8e41a2884bc4967440596a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:36.541132 25585 tablet_service.cc:1467] Processing CreateTablet for tablet 616587fb0f8e41a2884bc4967440596a (DEFAULT_TABLE table=test-table [id=51982387ae534868990a0d661652ec9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:36.542656 25585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616587fb0f8e41a2884bc4967440596a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:36.542600 25859 tablet_service.cc:1467] Processing CreateTablet for tablet 616587fb0f8e41a2884bc4967440596a (DEFAULT_TABLE table=test-table [id=51982387ae534868990a0d661652ec9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:36.543795 25859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616587fb0f8e41a2884bc4967440596a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:36.557668 25944 tablet_bootstrap.cc:492] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Bootstrap starting.
I20260808 02:41:36.559567 25946 tablet_bootstrap.cc:492] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Bootstrap starting.
I20260808 02:41:36.562263 25944 tablet_bootstrap.cc:654] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:36.563288 25946 tablet_bootstrap.cc:654] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:36.563501 25945 tablet_bootstrap.cc:492] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Bootstrap starting.
I20260808 02:41:36.563804 25944 log.cc:824] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:36.564575 25946 log.cc:824] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:36.567694 25944 tablet_bootstrap.cc:492] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: No bootstrap required, opened a new log
I20260808 02:41:36.568023 25944 ts_tablet_manager.cc:1397] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260808 02:41:36.568358 25946 tablet_bootstrap.cc:492] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: No bootstrap required, opened a new log
I20260808 02:41:36.568462 25945 tablet_bootstrap.cc:654] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:36.568689 25946 ts_tablet_manager.cc:1397] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:41:36.570154 25945 log.cc:824] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:36.574164 25945 tablet_bootstrap.cc:492] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: No bootstrap required, opened a new log
I20260808 02:41:36.574548 25945 ts_tablet_manager.cc:1397] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260808 02:41:36.576444 25944 raft_consensus.cc:348] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.576946 25944 raft_consensus.cc:374] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:36.577055 25944 raft_consensus.cc:729] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe70f5592a417894737aaa9ca5ea75, State: Initialized, Role: FOLLOWER
I20260808 02:41:36.577739 25944 consensus_queue.cc:260] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.578975 25926 heartbeater.cc:503] Master 127.10.20.126:44987 was elected leader, sending a full tablet report...
I20260808 02:41:36.579833 25944 ts_tablet_manager.cc:1428] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260808 02:41:36.580868 25946 raft_consensus.cc:348] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.581421 25946 raft_consensus.cc:374] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:36.581542 25946 raft_consensus.cc:729] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e27949598a4fcd8770f20d76b7f620, State: Initialized, Role: FOLLOWER
I20260808 02:41:36.582291 25946 consensus_queue.cc:260] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.584506 25946 ts_tablet_manager.cc:1428] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260808 02:41:36.588383 25945 raft_consensus.cc:348] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.588860 25945 raft_consensus.cc:374] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:36.588979 25945 raft_consensus.cc:729] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646f212391d42f4a18281c8eb483036, State: Initialized, Role: FOLLOWER
I20260808 02:41:36.589773 25945 consensus_queue.cc:260] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.591147 25791 heartbeater.cc:503] Master 127.10.20.126:44987 was elected leader, sending a full tablet report...
I20260808 02:41:36.592017 25945 ts_tablet_manager.cc:1428] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Time spent starting tablet: real 0.017s user 0.006s sys 0.012s
W20260808 02:41:36.617053 25654 tablet.cc:2369] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:41:36.646803 25792 tablet.cc:2369] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:41:36.690184 25927 tablet.cc:2369] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:36.832415 25951 raft_consensus.cc:482] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:41:36.832813 25951 raft_consensus.cc:504] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.835206 25951 leader_election.cc:288] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001), 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67:35541)
I20260808 02:41:36.843360 25943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.835896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:42511 (local address 127.10.20.67:35541)
0808 02:41:36.836147 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.836153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.837204 (+ 1051us) server_negotiation.cc:407] Connection header received
0808 02:41:36.837428 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.837433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.837496 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.837621 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:36.838393 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.839190 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.841367 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.842180 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.842314 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.842427 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.842960 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.843090 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 02:41:36.843379 25939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.835707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:44755 (local address 127.10.20.66:36001)
0808 02:41:36.835991 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.835999 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.837110 (+ 1111us) server_negotiation.cc:407] Connection header received
0808 02:41:36.837332 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.837340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.837445 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.837534 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:36.838244 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.839223 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.841315 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.842220 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.842455 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.842550 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.842928 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.843076 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:41:36.843502 25953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.835927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36001 (local address 127.10.20.65:44755)
0808 02:41:36.836948 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:36.836969 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:36.837132 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:36.837589 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:36.837597 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:36.837624 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:36.838069 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.838082 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.839394 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.839398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.841130 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.841144 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.842530 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.842535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.842699 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.842787 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 02:41:36.842887 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 02:41:36.843034 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"mutex_wait_us":131,"thread_start_us":494,"threads_started":1}
I20260808 02:41:36.843575 25954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.836024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:35541 (local address 127.10.20.65:42511)
0808 02:41:36.837025 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:36.837069 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:36.837256 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:36.837673 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:36.837679 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:36.837776 (+ 97us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:36.838187 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.838200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.839358 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.839365 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.841148 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:36.841162 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.842458 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.842465 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:36.842737 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.842794 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 02:41:36.842908 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 02:41:36.843068 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":9,"spinlock_wait_cycles":20864,"thread_start_us":671,"threads_started":1}
I20260808 02:41:36.844620 25743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616587fb0f8e41a2884bc4967440596a" candidate_uuid: "f6e27949598a4fcd8770f20d76b7f620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646f212391d42f4a18281c8eb483036" is_pre_election: true
I20260808 02:41:36.844637 25880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616587fb0f8e41a2884bc4967440596a" candidate_uuid: "f6e27949598a4fcd8770f20d76b7f620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe70f5592a417894737aaa9ca5ea75" is_pre_election: true
I20260808 02:41:36.845196 25743 raft_consensus.cc:2454] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6e27949598a4fcd8770f20d76b7f620 in term 0.
I20260808 02:41:36.845243 25880 raft_consensus.cc:2454] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6e27949598a4fcd8770f20d76b7f620 in term 0.
I20260808 02:41:36.846146 25539 leader_election.cc:302] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0646f212391d42f4a18281c8eb483036, 9bbe70f5592a417894737aaa9ca5ea75, f6e27949598a4fcd8770f20d76b7f620; no voters:
I20260808 02:41:36.846657 25951 raft_consensus.cc:2781] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:41:36.846873 25951 raft_consensus.cc:482] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:41:36.846999 25951 raft_consensus.cc:3037] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:36.849539 25951 raft_consensus.cc:504] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.850275 25951 leader_election.cc:288] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [CANDIDATE]: Term 1 election: Requested vote from peers 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001), 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67:35541)
I20260808 02:41:36.850864 25743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616587fb0f8e41a2884bc4967440596a" candidate_uuid: "f6e27949598a4fcd8770f20d76b7f620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646f212391d42f4a18281c8eb483036"
I20260808 02:41:36.850984 25880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616587fb0f8e41a2884bc4967440596a" candidate_uuid: "f6e27949598a4fcd8770f20d76b7f620" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe70f5592a417894737aaa9ca5ea75"
I20260808 02:41:36.851146 25743 raft_consensus.cc:3037] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:36.851289 25880 raft_consensus.cc:3037] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:36.853667 25743 raft_consensus.cc:2454] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6e27949598a4fcd8770f20d76b7f620 in term 1.
I20260808 02:41:36.853955 25880 raft_consensus.cc:2454] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6e27949598a4fcd8770f20d76b7f620 in term 1.
I20260808 02:41:36.854247 25539 leader_election.cc:302] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646f212391d42f4a18281c8eb483036, f6e27949598a4fcd8770f20d76b7f620; no voters:
I20260808 02:41:36.854599 25951 raft_consensus.cc:2781] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:36.855139 25951 raft_consensus.cc:686] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 1 LEADER]: Becoming Leader. State: Replica: f6e27949598a4fcd8770f20d76b7f620, State: Running, Role: LEADER
I20260808 02:41:36.855671 25951 consensus_queue.cc:237] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } }
I20260808 02:41:36.860679 25458 catalog_manager.cc:5495] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65). New cstate: current_term: 1 leader_uuid: "f6e27949598a4fcd8770f20d76b7f620" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6e27949598a4fcd8770f20d76b7f620" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 43309 } health_report { overall_health: HEALTHY } } }
I20260808 02:41:36.907140 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.900147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47182 (local address 127.10.20.65:43309)
0808 02:41:36.900366 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.900373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.900396 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:41:36.900594 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.900601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.900716 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.900893 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:41:36.901339 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.902575 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.904172 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.904893 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.905051 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.905635 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:41:36.906381 (+ 746us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:41:36.906546 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:36.906726 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 02:41:36.906825 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:41:36.916692 25743 raft_consensus.cc:1261] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Refusing update from remote peer f6e27949598a4fcd8770f20d76b7f620: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:36.916730 25880 raft_consensus.cc:1261] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Refusing update from remote peer f6e27949598a4fcd8770f20d76b7f620: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:36.917850 25955 consensus_queue.cc:1035] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe70f5592a417894737aaa9ca5ea75" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 35541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:36.918308 25951 consensus_queue.cc:1035] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646f212391d42f4a18281c8eb483036" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:36.950572 25458 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:36.951010 25458 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:36.955308 25458 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Sending DeleteTablet for 3 replicas of tablet 616587fb0f8e41a2884bc4967440596a
I20260808 02:41:36.956786 25859 tablet_service.cc:1514] Processing DeleteTablet for tablet 616587fb0f8e41a2884bc4967440596a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:36 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:58410
I20260808 02:41:36.956874 25585 tablet_service.cc:1514] Processing DeleteTablet for tablet 616587fb0f8e41a2884bc4967440596a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:36 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:47178
I20260808 02:41:36.957078 25723 tablet_service.cc:1514] Processing DeleteTablet for tablet 616587fb0f8e41a2884bc4967440596a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:36 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:41554
I20260808 02:41:36.957517 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 25500
I20260808 02:41:36.969906 25968 tablet_replica.cc:330] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: stopping tablet replica
I20260808 02:41:36.971009 25969 tablet_replica.cc:330] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: stopping tablet replica
I20260808 02:41:36.970971 25968 raft_consensus.cc:2229] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:36.971662 25969 raft_consensus.cc:2229] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:41:36.971728 25968 raft_consensus.cc:2258] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:36.972847 25970 tablet_replica.cc:330] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: stopping tablet replica
I20260808 02:41:36.972862 25969 raft_consensus.cc:2258] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:36.973353 25970 raft_consensus.cc:2229] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:36.973856 25970 raft_consensus.cc:2258] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:36.974617 25968 ts_tablet_manager.cc:1905] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:36.976886 25970 ts_tablet_manager.cc:1905] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:36.982852 25968 ts_tablet_manager.cc:1918] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:36.983011 25969 ts_tablet_manager.cc:1905] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:36.983210 25968 log.cc:1196] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/616587fb0f8e41a2884bc4967440596a
I20260808 02:41:36.983894 25968 ts_tablet_manager.cc:1939] T 616587fb0f8e41a2884bc4967440596a P 9bbe70f5592a417894737aaa9ca5ea75: Deleting consensus metadata
I20260808 02:41:36.985445 25970 ts_tablet_manager.cc:1918] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:36.985710 25970 log.cc:1196] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/616587fb0f8e41a2884bc4967440596a
I20260808 02:41:36.986248 25444 catalog_manager.cc:4841] TS 9bbe70f5592a417894737aaa9ca5ea75 (127.10.20.67:35541): tablet 616587fb0f8e41a2884bc4967440596a (table test-table [id=51982387ae534868990a0d661652ec9c]) successfully deleted
I20260808 02:41:36.986449 25970 ts_tablet_manager.cc:1939] T 616587fb0f8e41a2884bc4967440596a P 0646f212391d42f4a18281c8eb483036: Deleting consensus metadata
I20260808 02:41:36.988633 25447 catalog_manager.cc:4841] TS 0646f212391d42f4a18281c8eb483036 (127.10.20.66:36001): tablet 616587fb0f8e41a2884bc4967440596a (table test-table [id=51982387ae534868990a0d661652ec9c]) successfully deleted
I20260808 02:41:36.990221 25969 ts_tablet_manager.cc:1918] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:36.990442 25969 log.cc:1196] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/616587fb0f8e41a2884bc4967440596a
I20260808 02:41:36.991060 25969 ts_tablet_manager.cc:1939] T 616587fb0f8e41a2884bc4967440596a P f6e27949598a4fcd8770f20d76b7f620: Deleting consensus metadata
I20260808 02:41:36.993726 25445 catalog_manager.cc:4841] TS f6e27949598a4fcd8770f20d76b7f620 (127.10.20.65:43309): tablet 616587fb0f8e41a2884bc4967440596a (table test-table [id=51982387ae534868990a0d661652ec9c]) successfully deleted
I20260808 02:41:37.001570 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:36.959030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47192 (local address 127.10.20.65:43309)
0808 02:41:36.959293 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:36.959304 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:36.970659 (+ 11355us) server_negotiation.cc:407] Connection header received
0808 02:41:36.974746 (+ 4087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:36.974753 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:36.974887 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:36.974996 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:36.977831 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.979175 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.981467 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:36.982327 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:36.982478 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:36.993757 (+ 11279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:36.993784 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:36.993808 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:36.993879 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:36.997709 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:36.998769 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:36.998781 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:36.998784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:36.998972 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:36.999428 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:36.999434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:36.999439 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:36.999835 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:37.000252 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:37.000793 (+ 541us) server_negotiation.cc:299] Negotiation successful
0808 02:41:37.001179 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:41:37.002389 25648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:37.109921 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 25500
I20260808 02:41:37.132753 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 25657
I20260808 02:41:37.149610 25939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:37.133647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.10.20.66:36001)
0808 02:41:37.133847 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:37.133852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:37.133893 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:41:37.134159 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:37.134164 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:37.134238 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:37.134367 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:37.136242 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:37.137028 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:37.138437 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:37.139175 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:37.139289 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:37.142326 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:37.142361 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:37.142390 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:37.142433 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:37.145797 (+ 3364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:37.146841 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:37.146853 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:37.146859 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:37.147110 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:37.147608 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:37.147613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:37.147615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:37.148132 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:37.148566 (+ 434us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:37.148952 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 02:41:37.149215 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:41:37.150393 25786 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:37.245275 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 25657
I20260808 02:41:37.266438 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 25795
I20260808 02:41:37.283540 25943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:37.267589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58414 (local address 127.10.20.67:35541)
0808 02:41:37.267774 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:37.267779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:37.267800 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:41:37.268026 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:37.268030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:37.268102 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:37.268195 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:37.270040 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:37.270979 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:37.272685 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:37.273188 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:37.273377 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:37.276867 (+ 3490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:37.276885 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:37.276902 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:37.276972 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:37.280197 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:37.281128 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:37.281136 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:37.281138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:37.281303 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:37.281694 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:37.281698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:37.281700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:37.282156 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:37.282390 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:37.283066 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 02:41:37.283258 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:41:37.284235 25921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:37.382929 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 25795
I20260808 02:41:37.405683 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 25426
I20260808 02:41:37.407558 25492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:37.529139 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 25426
I20260808 02:41:37.556998 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44987
--webserver_interface=127.10.20.126
--webserver_port=33271
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:44987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:37.964676 25976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:37.965019 25976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:37.965202 25976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:37.973337 25976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:37.973490 25976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:37.973582 25976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:37.973672 25976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:37.973755 25976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:37.984939 25976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:44987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:44987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=33271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:37.986486 25976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:37.987998 25976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:38.002547 25981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:38.002447 25982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:38.002549 25984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:38.004070 25976 server_base.cc:1034] running on GCE node
I20260808 02:41:38.005175 25976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:38.007210 25976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:38.008550 25976 hybrid_clock.cc:648] HybridClock initialized: now 1786156898008494 us; error 81 us; skew 500 ppm
I20260808 02:41:38.008984 25976 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:38 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156898, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:38.012954 25976 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:38.014882 25976 webserver.cc:460] Webserver started at http://127.10.20.126:33271/ using document root <none> and password file <none>
I20260808 02:41:38.015710 25976 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:38.015878 25976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:38.022490 25976 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.001s
I20260808 02:41:38.026145 25991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:38.027989 25976 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:38.028221 25976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "80c28a2ea0a741d9be542206f29be7d6"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "f02e26d98d034de34c53b0363dd21faf"
server_key_iv: "010578436bb13907763f1170866175d1"
server_key_version: "encryptionkey@0"
I20260808 02:41:38.029326 25976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:38.049752 25976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:38.055191 25976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:38.055542 25976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:38.077085 26046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:44987 every 8 connection(s)
I20260808 02:41:38.077194 25976 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:44987
I20260808 02:41:38.079046 25976 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:38.083561 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 25976
I20260808 02:41:38.084647 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:43309
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:44987
--webserver_port=38161
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:38.088326 26047 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:41:38.094139 26047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap starting.
I20260808 02:41:38.117805 26047 log.cc:824] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:38.136791 26047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:41:38.137411 26047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6: Bootstrap complete.
I20260808 02:41:38.147588 26047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:38.148613 26047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80c28a2ea0a741d9be542206f29be7d6, State: Initialized, Role: FOLLOWER
I20260808 02:41:38.149349 26047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:38.149621 26047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:38.149758 26047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:38.149956 26047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260808 02:41:38.154301 26047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:38.154946 26047 leader_election.cc:302] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80c28a2ea0a741d9be542206f29be7d6; no voters:
I20260808 02:41:38.155696 26047 leader_election.cc:288] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 02:41:38.155853 26051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 02:41:38.157164 26051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [term 3 LEADER]: Becoming Leader. State: Replica: 80c28a2ea0a741d9be542206f29be7d6, State: Running, Role: LEADER
I20260808 02:41:38.157832 26051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } }
I20260808 02:41:38.158120 26047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:38.161154 26053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80c28a2ea0a741d9be542206f29be7d6. Latest consensus state: current_term: 3 leader_uuid: "80c28a2ea0a741d9be542206f29be7d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } } }
I20260808 02:41:38.161473 26053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:38.160827 26052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "80c28a2ea0a741d9be542206f29be7d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c28a2ea0a741d9be542206f29be7d6" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 44987 } } }
I20260808 02:41:38.162025 26052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c28a2ea0a741d9be542206f29be7d6 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:38.166709 26058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:38.175891 26058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:38.177702 26058 catalog_manager.cc:1259] Loaded cluster ID: 07bf9f045c854c19b5aa22b3797cb48e
I20260808 02:41:38.177923 26058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 02:41:38.180241 26058 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc203f279ad google::LogMessage::Fail() at ??:0
@ 0x7fc203f2a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc203f274de google::LogMessage::Flush() at ??:0
@ 0x7fc203f28a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc21995e512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
I20260808 02:41:38.197134 26071 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7fc21995b976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc2199e3610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fc2199e3439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc206b73345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc206b7691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc206b76799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc206b51eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc209e2b6db start_thread at ??:0
@ 0x7fc202dc161f clone at ??:0
W20260808 02:41:38.521140 26049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:38.521544 26049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:38.521736 26049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:38.529915 26049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:38.530148 26049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:38.530347 26049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:41:38.541783 26049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:43309
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=38161
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:38.543355 26049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:38.544809 26049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:38.561760 26092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:38.561726 26093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:38.561726 26095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:38.562925 26049 server_base.cc:1034] running on GCE node
I20260808 02:41:38.563671 26049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:38.564826 26049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:38.566110 26049 hybrid_clock.cc:648] HybridClock initialized: now 1786156898566066 us; error 37 us; skew 500 ppm
I20260808 02:41:38.566515 26049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:38 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156898, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:38.570573 26049 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:41:38.572570 26049 webserver.cc:460] Webserver started at http://127.10.20.65:38161/ using document root <none> and password file <none>
I20260808 02:41:38.573438 26049 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:38.573592 26049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:38.579923 26049 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:41:38.583344 26102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:38.585067 26049 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260808 02:41:38.585352 26049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "f6e27949598a4fcd8770f20d76b7f620"
format_stamp: "Formatted at 2026-08-08 02:41:31 on dist-test-slave-8tdl"
server_key: "3d7a1c351cde8e93958fe20813f71a2f"
server_key_iv: "7ef3f5bd06b8636e14c1544031e86aad"
server_key_version: "encryptionkey@0"
I20260808 02:41:38.586454 26049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:38.600251 26049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:38.605370 26049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:38.605716 26049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:38.606988 26049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:38.608486 26049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:38.608595 26049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:38.608765 26049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:38.608892 26049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:38.648475 26049 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:43309
I20260808 02:41:38.648602 26217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:43309 every 8 connection(s)
I20260808 02:41:38.650363 26049 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:41:38.654909 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26049
I20260808 02:41:38.655707 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:36001
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:44987
--webserver_port=38677
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:38.656582 26221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:38.653957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:53961)
0808 02:41:38.655140 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:38.655425 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":436,"threads_started":1}
W20260808 02:41:38.657531 26218 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:44987 (0 consecutive failures): Network error: Failed to ping master at 127.10.20.126:44987: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
I20260808 02:41:38.658806 26221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:38.658315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:35833)
0808 02:41:38.658534 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:38.658615 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 02:41:38.660362 26221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:38.659828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:36451)
0808 02:41:38.660045 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:38.660166 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 02:41:38.660755 26218 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:41:39.075963 26222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:39.076301 26222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:39.076448 26222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:39.085731 26222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:39.085891 26222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:39.086202 26222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:41:39.099643 26222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:36001
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=38677
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:39.101167 26222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:39.102896 26222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:39.118865 26228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:39.118856 26231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:39.119565 26229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:39.120079 26222 server_base.cc:1034] running on GCE node
I20260808 02:41:39.120831 26222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:39.122061 26222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:39.123329 26222 hybrid_clock.cc:648] HybridClock initialized: now 1786156899123278 us; error 43 us; skew 500 ppm
I20260808 02:41:39.123728 26222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:39 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:39.127990 26222 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:41:39.129801 26222 webserver.cc:460] Webserver started at http://127.10.20.66:38677/ using document root <none> and password file <none>
I20260808 02:41:39.130632 26222 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:39.130971 26222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:39.138003 26222 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:41:39.141433 26238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:39.143456 26222 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:39.143689 26222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "0646f212391d42f4a18281c8eb483036"
format_stamp: "Formatted at 2026-08-08 02:41:32 on dist-test-slave-8tdl"
server_key: "3e313c143bff8d7c0c11cb85b8c29eb6"
server_key_iv: "b1ae020533d636da2e7f48f1f0286aeb"
server_key_version: "encryptionkey@0"
I20260808 02:41:39.144830 26222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:39.167781 26222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:39.172874 26222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:39.173233 26222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:39.174559 26222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:39.176211 26222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:39.176350 26222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:39.176507 26222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:39.176604 26222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:39.217298 26222 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36001
I20260808 02:41:39.217368 26352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36001 every 8 connection(s)
I20260808 02:41:39.219117 26222 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:41:39.224735 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.222520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:35165)
0808 02:41:39.223458 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.223705 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":438,"threads_started":1}
I20260808 02:41:39.225328 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26222
W20260808 02:41:39.225627 26353 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:44987 (0 consecutive failures): Network error: Failed to ping master at 127.10.20.126:44987: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
I20260808 02:41:39.226197 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:35541
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:44987
--webserver_port=45817
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:39.226850 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.226313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:44571)
0808 02:41:39.226567 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.226657 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260808 02:41:39.227829 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.227451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:44413)
0808 02:41:39.227608 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.227709 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:41:39.228101 26353 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:41:39.612702 26357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:39.613044 26357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:39.613215 26357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:39.620926 26357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:39.621068 26357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:39.621256 26357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:41:39.631731 26357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:35541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=45817
--tserver_master_addrs=127.10.20.126:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:39.633312 26357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:39.634902 26357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:39.650169 26364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:39.650246 26366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:39.650197 26363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:39.657016 26357 server_base.cc:1034] running on GCE node
I20260808 02:41:39.657778 26357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:39.658999 26357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:39.660255 26357 hybrid_clock.cc:648] HybridClock initialized: now 1786156899660212 us; error 48 us; skew 500 ppm
I20260808 02:41:39.660614 26357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:41:39.662462 26369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.661352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:45131)
0808 02:41:39.662006 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.662135 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":269,"threads_started":1}
Aug 08 02:41:39 dist-test-slave-8tdl krb5kdc[24857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:39.664702 26357 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:41:39.666462 26357 webserver.cc:460] Webserver started at http://127.10.20.67:45817/ using document root <none> and password file <none>
I20260808 02:41:39.667342 26357 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:39.667513 26357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:39.673700 26357 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 02:41:39.677385 26374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:39.679239 26357 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 02:41:39.679464 26357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "9bbe70f5592a417894737aaa9ca5ea75"
format_stamp: "Formatted at 2026-08-08 02:41:33 on dist-test-slave-8tdl"
server_key: "31c44a321fafca38d8b4c2852a524bd7"
server_key_iv: "59da7e5433e82ed225d5007f4bccd31c"
server_key_version: "encryptionkey@0"
I20260808 02:41:39.680586 26357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:39.716197 26357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:39.721544 26357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:39.721916 26357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:39.723604 26357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:39.725961 26357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:39.726099 26357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:39.726230 26357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:39.726329 26357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:39.765338 26357 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:35541
I20260808 02:41:39.765481 26492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:35541 every 8 connection(s)
I20260808 02:41:39.767081 26357 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:41:39.773029 26495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.770794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:49767)
0808 02:41:39.771795 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.772085 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":511,"threads_started":1}
W20260808 02:41:39.774046 26493 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:44987 (0 consecutive failures): Network error: Failed to ping master at 127.10.20.126:44987: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
I20260808 02:41:39.774231 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26357
I20260808 02:41:39.775192 26495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.774785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:43697)
0808 02:41:39.774989 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.775066 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 02:41:39.776547 26495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:39.775996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:48497)
0808 02:41:39.776306 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:39.776391 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260808 02:41:39.776818 26493 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 02:41:40.230211 26497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:40.228949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:32985)
0808 02:41:40.229714 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:40.229876 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":443,"threads_started":1}
I20260808 02:41:40.664863 26498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:40.663764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:47169)
0808 02:41:40.664499 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:40.664626 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":332,"threads_started":1}
I20260808 02:41:40.778424 26499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:40.777455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:56733)
0808 02:41:40.778038 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:40.778148 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":257,"threads_started":1}
I20260808 02:41:41.232388 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:41.231514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:41919)
0808 02:41:41.232115 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:41.232207 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":337,"threads_started":1}
I20260808 02:41:41.667029 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:41.665973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:51637)
0808 02:41:41.666537 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:41.666636 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":292,"threads_started":1}
I20260808 02:41:41.780754 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:41.779740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:39011)
0808 02:41:41.780410 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:41.780521 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":364,"threads_started":1}
I20260808 02:41:42.234503 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:42.233476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:52511)
0808 02:41:42.234152 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:42.234283 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":296,"threads_started":1}
I20260808 02:41:42.669126 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:42.668177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:55519)
0808 02:41:42.668737 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:42.668849 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":298,"threads_started":1}
I20260808 02:41:42.782847 26505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:42.781908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:56761)
0808 02:41:42.782425 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:42.782555 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":277,"threads_started":1}
I20260808 02:41:43.236784 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:43.235839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:48615)
0808 02:41:43.236493 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:43.236593 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":303,"threads_started":1}
I20260808 02:41:43.671454 26507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:43.670437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:54671)
0808 02:41:43.671164 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:43.671254 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":470,"threads_started":1}
I20260808 02:41:43.785271 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:43.784207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:59367)
0808 02:41:43.784858 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:43.784987 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":304,"threads_started":1}
I20260808 02:41:44.239168 26509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:44.238101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:60415)
0808 02:41:44.238761 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:44.238891 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":322,"threads_started":1}
I20260808 02:41:44.673753 26510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:44.672678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:39189)
0808 02:41:44.673412 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:44.673536 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":410,"threads_started":1}
I20260808 02:41:44.787559 26511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:44.786588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:42001)
0808 02:41:44.787248 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:44.787353 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":415,"threads_started":1}
I20260808 02:41:45.241420 26512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:45.240472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:33721)
0808 02:41:45.241103 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:45.241234 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":410,"threads_started":1}
I20260808 02:41:45.676011 26513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:45.675051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:51317)
0808 02:41:45.675679 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:45.675774 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":297,"threads_started":1}
I20260808 02:41:45.789498 26514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:45.788629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:41487)
0808 02:41:45.789158 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:45.789261 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":282,"threads_started":1}
I20260808 02:41:46.243737 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:46.242664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:46509)
0808 02:41:46.243381 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:46.243515 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":326,"threads_started":1}
I20260808 02:41:46.678192 26516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:46.677254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:47701)
0808 02:41:46.677913 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:46.678013 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":410,"threads_started":1}
I20260808 02:41:46.791778 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:46.790753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:37417)
0808 02:41:46.791455 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:46.791554 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":346,"threads_started":1}
I20260808 02:41:47.246140 26518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:47.245117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:50761)
0808 02:41:47.245859 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:47.245963 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":413,"threads_started":1}
I20260808 02:41:47.680315 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:47.679421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:52217)
0808 02:41:47.680023 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:47.680119 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":284,"threads_started":1}
I20260808 02:41:47.793700 26521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:47.792873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:60687)
0808 02:41:47.793443 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:47.793532 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":329,"threads_started":1}
I20260808 02:41:48.248320 26522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:48.247462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:47957)
0808 02:41:48.248025 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:48.248133 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":278,"threads_started":1}
I20260808 02:41:48.682436 26523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:48.681563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:59643)
0808 02:41:48.682126 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:48.682224 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":322,"threads_started":1}
I20260808 02:41:48.796094 26524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:48.794991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:38345)
0808 02:41:48.795717 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:48.795898 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":438,"threads_started":1}
I20260808 02:41:49.250617 26525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:49.249578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:35615)
0808 02:41:49.250160 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:49.250281 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":285,"threads_started":1}
I20260808 02:41:49.684473 26526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:49.683543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:56873)
0808 02:41:49.684106 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:49.684207 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":286,"threads_started":1}
I20260808 02:41:49.798050 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:49.797240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:46861)
0808 02:41:49.797779 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:49.797862 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":335,"threads_started":1}
I20260808 02:41:50.252751 26528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:50.251903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:32985)
0808 02:41:50.252421 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:50.252559 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":261,"threads_started":1}
I20260808 02:41:50.687132 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:50.685849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:43593)
0808 02:41:50.686769 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:50.686880 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":568,"threads_started":1}
I20260808 02:41:50.800256 26530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:50.799395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:53739)
0808 02:41:50.799925 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:50.800034 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":264,"threads_started":1}
I20260808 02:41:51.254804 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:51.253945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:44413)
0808 02:41:51.254456 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:51.254545 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":270,"threads_started":1}
I20260808 02:41:51.689500 26532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:51.688471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:60573)
0808 02:41:51.689129 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:51.689257 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":309,"threads_started":1}
I20260808 02:41:51.802737 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:51.801568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:56061)
0808 02:41:51.802392 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:51.802506 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":290,"threads_started":1}
I20260808 02:41:52.256693 26534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:52.255872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:58307)
0808 02:41:52.256384 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:52.256487 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":252,"threads_started":1}
I20260808 02:41:52.691672 26535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:52.690607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:42589)
0808 02:41:52.691390 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:52.691481 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":295,"threads_started":1}
I20260808 02:41:52.804773 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:52.803950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:55925)
0808 02:41:52.804493 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:52.804583 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":261,"threads_started":1}
I20260808 02:41:53.258792 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:53.257811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:43017)
0808 02:41:53.258374 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:53.258468 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":319,"threads_started":1}
I20260808 02:41:53.693967 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:53.692931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:35127)
0808 02:41:53.693545 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:53.693682 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":323,"threads_started":1}
I20260808 02:41:53.806739 26540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:53.805857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:42877)
0808 02:41:53.806371 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:53.806480 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":259,"threads_started":1}
I20260808 02:41:54.261209 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:54.260345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.66:33819)
0808 02:41:54.260901 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:54.261009 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":303,"threads_started":1}
I20260808 02:41:54.696198 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:54.695279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.65:47545)
0808 02:41:54.695850 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:54.696016 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":302,"threads_started":1}
I20260808 02:41:54.787990 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26049
I20260808 02:41:54.809260 26544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:54.808262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:44987 (local address 127.10.20.67:47083)
0808 02:41:54.808861 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:54.808997 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:44987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":298,"threads_started":1}
I20260808 02:41:54.809883 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:54.789527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50256 (local address 127.10.20.65:43309)
0808 02:41:54.790322 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:54.790343 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:54.790406 (+ 63us) server_negotiation.cc:407] Connection header received
0808 02:41:54.792764 (+ 2358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:54.792775 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:54.793257 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:54.793654 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:54.795510 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:54.796812 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:54.798205 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:54.799083 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:54.799322 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:54.802360 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:54.802369 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:54.802390 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:54.802448 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:54.805791 (+ 3343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:54.806641 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:54.806649 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:54.806657 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:54.806923 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:54.807383 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:54.807388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:54.807393 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:54.808165 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:54.808555 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:54.809097 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 02:41:54.809558 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":419,"threads_started":1}
I20260808 02:41:54.811717 26213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:54.901744 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26049
I20260808 02:41:54.926043 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26222
I20260808 02:41:54.946254 26546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:54.927212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33588 (local address 127.10.20.66:36001)
0808 02:41:54.927791 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:54.927806 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:54.927909 (+ 103us) server_negotiation.cc:407] Connection header received
0808 02:41:54.929581 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:54.929592 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:54.930114 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:54.930446 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:54.932078 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:54.933393 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:54.934883 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:54.935627 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:54.935776 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:54.938877 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:54.938893 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:54.938918 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:54.938980 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:54.942220 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:54.943170 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:54.943178 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:54.943185 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:54.943383 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:54.943785 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:54.943789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:54.943791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:54.944515 (+ 724us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:54.944775 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:54.945439 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 02:41:54.945952 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":278,"threads_started":1}
I20260808 02:41:54.947902 26348 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:55.039456 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26222
I20260808 02:41:55.062296 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26357
I20260808 02:41:55.084844 26548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:55.063506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51396 (local address 127.10.20.67:35541)
0808 02:41:55.064231 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:55.064246 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:55.064291 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:41:55.066029 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:55.066040 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:55.066483 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:55.066941 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:55.068875 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:55.070398 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:55.072010 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:55.072839 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:55.073014 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:55.076670 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:55.076680 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:55.076700 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:55.076751 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:55.080426 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:55.081484 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:55.081492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:55.081501 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:55.081722 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:55.082227 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:55.082231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:55.082233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:55.082979 (+ 746us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:55.083283 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:55.083869 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 02:41:55.084449 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":325,"threads_started":1}
I20260808 02:41:55.086611 26488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:55.175772 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26357
2026-08-08T02:41:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (26117 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:41:55 dist-test-slave-8tdl krb5kdc[26552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:41:55 dist-test-slave-8tdl krb5kdc[26552](info): set up 2 sockets
Aug 08 02:41:55 dist-test-slave-8tdl krb5kdc[26552](info): commencing operation
krb5kdc: starting...
W20260808 02:41:56.380671 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:41:56 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:41:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:41:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:41:56.744017 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39989
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:39989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:57.138757 26565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:57.139209 26565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:57.139390 26565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:57.148175 26565 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 02:41:57.148363 26565 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 02:41:57.148464 26565 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 02:41:57.148566 26565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:41:57.148674 26565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:57.148805 26565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:57.148906 26565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:41:57.148993 26565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:41:57.160041 26565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:39989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:57.161566 26565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:57.163116 26565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 02:41:57.177969 26565 server_base.cc:1034] running on GCE node
W20260808 02:41:57.177948 26571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:57.177917 26572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:57.178121 26574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:57.179785 26565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:57.181542 26565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:57.182862 26565 hybrid_clock.cc:648] HybridClock initialized: now 1786156917182761 us; error 52 us; skew 500 ppm
I20260808 02:41:57.183350 26565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:57 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156917, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:57.191193 26565 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:41:57.192987 26565 webserver.cc:460] Webserver started at http://127.10.20.126:42447/ using document root <none> and password file <none>
I20260808 02:41:57.193835 26565 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:57.193992 26565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:57.194363 26565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:57.197883 26565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "aade7cf84f094955951124bc9923f5e4"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "53abc2a471317a740c194ef622f5d013"
server_key_iv: "f9e6e6a08fbd42caf0f805e673dced0f"
server_key_version: "encryptionkey@0"
I20260808 02:41:57.198959 26565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "aade7cf84f094955951124bc9923f5e4"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "53abc2a471317a740c194ef622f5d013"
server_key_iv: "f9e6e6a08fbd42caf0f805e673dced0f"
server_key_version: "encryptionkey@0"
I20260808 02:41:57.205430 26565 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260808 02:41:57.209987 26581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:57.211948 26565 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:57.212250 26565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "aade7cf84f094955951124bc9923f5e4"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "53abc2a471317a740c194ef622f5d013"
server_key_iv: "f9e6e6a08fbd42caf0f805e673dced0f"
server_key_version: "encryptionkey@0"
I20260808 02:41:57.212548 26565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:57.227806 26565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:57.233206 26565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:57.233556 26565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:57.257135 26565 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:39989
I20260808 02:41:57.257151 26633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:39989 every 8 connection(s)
I20260808 02:41:57.258853 26565 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:41:57.261118 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26565
I20260808 02:41:57.261373 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:41:57.262332 10321 external_mini_cluster.cc:1428] Setting key 7981e88e5b1b505e263364dc08dffa39
I20260808 02:41:57.264238 26634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:41:57 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:57.280560 26634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap starting.
I20260808 02:41:57.284653 26634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:57.286020 26634 log.cc:824] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:57.289464 26634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: No bootstrap required, opened a new log
I20260808 02:41:57.290477 26637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:57.264839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55092 (local address 127.10.20.126:39989)
0808 02:41:57.265720 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:57.265733 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:57.265775 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:41:57.267564 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:57.267589 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:57.268043 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:57.268405 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:57.270530 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:57.272252 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:57.274272 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:57.275276 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:57.275442 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:57.281025 (+ 5583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:57.281035 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:57.281052 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:57.281101 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:57.285104 (+ 4003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:57.286265 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:57.286275 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:57.286283 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:57.286507 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:57.287044 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:57.287062 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:57.287064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:57.287719 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:57.288080 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:57.288626 (+ 546us) server_negotiation.cc:299] Negotiation successful
0808 02:41:57.289148 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":421,"threads_started":1}
I20260808 02:41:57.298204 26634 raft_consensus.cc:348] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:41:57.298770 26634 raft_consensus.cc:374] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:57.298899 26634 raft_consensus.cc:729] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aade7cf84f094955951124bc9923f5e4, State: Initialized, Role: FOLLOWER
I20260808 02:41:57.299674 26634 consensus_queue.cc:260] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:41:57.299973 26634 raft_consensus.cc:388] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:41:57.300143 26634 raft_consensus.cc:482] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:41:57.300348 26634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:57.302831 26634 raft_consensus.cc:504] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:41:57.303423 26634 leader_election.cc:302] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aade7cf84f094955951124bc9923f5e4; no voters:
I20260808 02:41:57.304241 26634 leader_election.cc:288] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:41:57.304365 26639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:57.305841 26639 raft_consensus.cc:686] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 LEADER]: Becoming Leader. State: Replica: aade7cf84f094955951124bc9923f5e4, State: Running, Role: LEADER
I20260808 02:41:57.306416 26639 consensus_queue.cc:237] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:41:57.307052 26634 sys_catalog.cc:564] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:41:57.309898 26640 sys_catalog.cc:455] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aade7cf84f094955951124bc9923f5e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } } }
I20260808 02:41:57.310336 26640 sys_catalog.cc:458] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:57.312137 26646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:41:57.312491 26641 sys_catalog.cc:455] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aade7cf84f094955951124bc9923f5e4. Latest consensus state: current_term: 1 leader_uuid: "aade7cf84f094955951124bc9923f5e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } } }
I20260808 02:41:57.312742 26641 sys_catalog.cc:458] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: This master's current role is: LEADER
I20260808 02:41:57.319543 26646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:41:57.332885 26646 catalog_manager.cc:1347] Generated new cluster ID: e7f676de962f45ef808a43a802f72e84
I20260808 02:41:57.333106 26646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:41:57.347653 26646 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:41:57.350183 26646 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:41:57.366930 26646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Generated new TSK 0
I20260808 02:41:57.368032 26646 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:41:57.474083 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:39989
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:57.899061 26662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:57.899395 26662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:57.899507 26662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:57.907227 26662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:57.907459 26662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:57.907609 26662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:41:57.918354 26662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:57.919910 26662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:57.921429 26662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:57.937274 26667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:57.937659 26668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:57.938112 26670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:57.945719 26662 server_base.cc:1034] running on GCE node
I20260808 02:41:57.946602 26662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:57.947894 26662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:57.949193 26662 hybrid_clock.cc:648] HybridClock initialized: now 1786156917949131 us; error 64 us; skew 500 ppm
I20260808 02:41:57.949637 26662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:57 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156917, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:57.953997 26662 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:41:57.956205 26662 webserver.cc:460] Webserver started at http://127.10.20.65:42545/ using document root <none> and password file <none>
I20260808 02:41:57.957122 26662 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:57.957324 26662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:57.957705 26662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:57.961333 26662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "9c86186cc26746d99b1b06e1d98a613f"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "48f60b80a80c04e8ab452b37ca534338"
server_key_iv: "baec5d1bc3dd0960128b002486f9eb5a"
server_key_version: "encryptionkey@0"
I20260808 02:41:57.962324 26662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "9c86186cc26746d99b1b06e1d98a613f"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "48f60b80a80c04e8ab452b37ca534338"
server_key_iv: "baec5d1bc3dd0960128b002486f9eb5a"
server_key_version: "encryptionkey@0"
I20260808 02:41:57.969004 26662 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:41:57.973487 26678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:57.975682 26662 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:41:57.975936 26662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "9c86186cc26746d99b1b06e1d98a613f"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "48f60b80a80c04e8ab452b37ca534338"
server_key_iv: "baec5d1bc3dd0960128b002486f9eb5a"
server_key_version: "encryptionkey@0"
I20260808 02:41:57.976210 26662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:57.990499 26662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:57.996114 26662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:57.996466 26662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:57.997575 26662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:57.999764 26662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:57.999881 26662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:58.000049 26662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:58.000133 26662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:58.042277 26662 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:41481
I20260808 02:41:58.042294 26793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:41481 every 8 connection(s)
I20260808 02:41:58.043849 26662 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:41:58.050263 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26662
I20260808 02:41:58.050529 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:41:58.051438 10321 external_mini_cluster.cc:1428] Setting key 62dc21aa82262ec2816f011de0796912
Aug 08 02:41:58 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156917, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:58.071219 26796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:58.047190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:54755 (local address 127.10.20.126:39989)
0808 02:41:58.047768 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:58.047776 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:58.048875 (+ 1099us) server_negotiation.cc:407] Connection header received
0808 02:41:58.051075 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:58.051083 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:58.051196 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:58.051346 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:58.053302 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.054233 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.057168 (+ 2935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.057654 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.057774 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:58.063080 (+ 5306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:58.063091 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:58.063099 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:58.063156 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:58.067115 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:58.068187 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:58.068196 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:58.068203 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:58.068406 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:58.069027 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:58.069035 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:58.069040 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:58.069491 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:58.069656 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:58.070507 (+ 851us) server_negotiation.cc:299] Negotiation successful
0808 02:41:58.070815 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":286,"threads_started":1}
I20260808 02:41:58.072304 26797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:58.047721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:54755)
0808 02:41:58.048645 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:58.048691 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:58.050716 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:58.051702 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:58.051711 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:58.052351 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:58.053096 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:58.053115 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.054424 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.054470 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:58.056945 (+ 2475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:58.056977 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.057927 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.057934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:58.058306 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:58.059299 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:58.059404 (+ 105us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:58.062643 (+ 3239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:58.067332 (+ 4689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:58.067349 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:58.067366 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:58.068021 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:58.068556 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:58.068559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:58.068562 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:58.068898 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:58.069666 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:58.069676 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:58.070094 (+ 418us) client_negotiation.cc:769] Sending connection context
0808 02:41:58.070392 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 02:41:58.071054 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":375,"threads_started":1}
I20260808 02:41:58.074352 26794 heartbeater.cc:347] Connected to a master server at 127.10.20.126:39989
I20260808 02:41:58.074777 26794 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:58.075812 26794 heartbeater.cc:511] Master 127.10.20.126:39989 requested a full tablet report, sending...
I20260808 02:41:58.078714 26598 ts_manager.cc:194] Registered new tserver with Master: 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65:41481)
I20260808 02:41:58.081199 26598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:54755
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:41:58.139612 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:39989
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:41:58.523370 26800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:58.523746 26800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:58.523876 26800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:58.531790 26800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:58.531966 26800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:58.532141 26800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:41:58.542587 26800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:58.544176 26800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:58.545580 26800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:58.560407 26805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:58.560366 26808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:58.560456 26806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:58.564777 26800 server_base.cc:1034] running on GCE node
I20260808 02:41:58.565569 26800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:58.566741 26800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:58.568018 26800 hybrid_clock.cc:648] HybridClock initialized: now 1786156918567957 us; error 54 us; skew 500 ppm
I20260808 02:41:58.568397 26800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:58 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156918, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:58.572135 26800 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:41:58.573930 26800 webserver.cc:460] Webserver started at http://127.10.20.66:39865/ using document root <none> and password file <none>
I20260808 02:41:58.574776 26800 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:58.574961 26800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:58.575309 26800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:58.578540 26800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "842965708973470f93d1550bb8a9c0c6"
format_stamp: "Formatted at 2026-08-08 02:41:58 on dist-test-slave-8tdl"
server_key: "4da3f2bc3e909b53343906cf3c1c7fbc"
server_key_iv: "487d4398ba51aa69976a8c40c145fe9a"
server_key_version: "encryptionkey@0"
I20260808 02:41:58.579450 26800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "842965708973470f93d1550bb8a9c0c6"
format_stamp: "Formatted at 2026-08-08 02:41:58 on dist-test-slave-8tdl"
server_key: "4da3f2bc3e909b53343906cf3c1c7fbc"
server_key_iv: "487d4398ba51aa69976a8c40c145fe9a"
server_key_version: "encryptionkey@0"
I20260808 02:41:58.585713 26800 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:41:58.589712 26815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:58.591362 26800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:41:58.591586 26800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "842965708973470f93d1550bb8a9c0c6"
format_stamp: "Formatted at 2026-08-08 02:41:58 on dist-test-slave-8tdl"
server_key: "4da3f2bc3e909b53343906cf3c1c7fbc"
server_key_iv: "487d4398ba51aa69976a8c40c145fe9a"
server_key_version: "encryptionkey@0"
I20260808 02:41:58.591830 26800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:58.612416 26800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:58.617657 26800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:58.618000 26800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:58.619338 26800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:58.620957 26800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:58.621080 26800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:58.621243 26800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:58.621316 26800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:58.659147 26800 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36721
I20260808 02:41:58.659183 26932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36721 every 8 connection(s)
I20260808 02:41:58.660540 26800 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:41:58.667150 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26800
I20260808 02:41:58.667366 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:41:58.667837 10321 external_mini_cluster.cc:1428] Setting key 6789d89614bab1791e132ce516365596
Aug 08 02:41:58 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156918, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:58.686487 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:58.663685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:53085 (local address 127.10.20.126:39989)
0808 02:41:58.664173 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:58.664178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:58.665201 (+ 1023us) server_negotiation.cc:407] Connection header received
0808 02:41:58.667211 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:58.667217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:58.667351 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:58.667489 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:58.669555 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.670532 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.672424 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.673237 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.673426 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:58.678016 (+ 4590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:58.678027 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:58.678035 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:58.678086 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:58.682215 (+ 4129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:58.683368 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:58.683378 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:58.683384 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:58.683570 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:58.684178 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:58.684186 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:58.684191 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:58.684642 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:58.684814 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:58.685664 (+ 850us) server_negotiation.cc:299] Negotiation successful
0808 02:41:58.685986 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":239,"threads_started":1}
I20260808 02:41:58.687466 26936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:58.664214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:53085)
0808 02:41:58.665010 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:58.665051 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:58.666898 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:58.667770 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:58.667779 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:58.668459 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:58.669319 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:58.669361 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.670820 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.670825 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:58.672218 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:58.672234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:58.673554 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:58.673560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:58.673812 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:58.674807 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:58.674835 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:58.677677 (+ 2842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:58.682448 (+ 4771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:58.682460 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:58.682482 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:58.683191 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:58.683736 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:58.683740 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:58.683742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:58.683978 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:58.684799 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:58.684806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:58.685252 (+ 446us) client_negotiation.cc:769] Sending connection context
0808 02:41:58.685512 (+ 260us) client_negotiation.cc:240] Negotiation successful
0808 02:41:58.685956 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":319,"threads_started":1}
I20260808 02:41:58.689366 26933 heartbeater.cc:347] Connected to a master server at 127.10.20.126:39989
I20260808 02:41:58.689750 26933 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:58.690605 26933 heartbeater.cc:511] Master 127.10.20.126:39989 requested a full tablet report, sending...
I20260808 02:41:58.692349 26598 ts_manager.cc:194] Registered new tserver with Master: 842965708973470f93d1550bb8a9c0c6 (127.10.20.66:36721)
I20260808 02:41:58.693254 26598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:53085
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:41:58.752476 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:39989
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:41:59.086057 26794 heartbeater.cc:503] Master 127.10.20.126:39989 was elected leader, sending a full tablet report...
W20260808 02:41:59.151856 26939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:41:59.152281 26939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:41:59.152506 26939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:41:59.160386 26939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:41:59.160588 26939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:41:59.160775 26939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:41:59.173326 26939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:41:59.175259 26939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:41:59.176777 26939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:41:59.192600 26944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:59.192688 26945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:41:59.193023 26947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:41:59.194108 26939 server_base.cc:1034] running on GCE node
I20260808 02:41:59.194933 26939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:41:59.196080 26939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:41:59.197319 26939 hybrid_clock.cc:648] HybridClock initialized: now 1786156919197276 us; error 44 us; skew 500 ppm
I20260808 02:41:59.197722 26939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:41:59 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156919, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:41:59.201452 26939 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:41:59.203341 26939 webserver.cc:460] Webserver started at http://127.10.20.67:39509/ using document root <none> and password file <none>
I20260808 02:41:59.204120 26939 fs_manager.cc:359] Metadata directory not provided
I20260808 02:41:59.204239 26939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:41:59.204533 26939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:41:59.208057 26939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "31e29a00c1474f64b3d87cc15695afb0"
format_stamp: "Formatted at 2026-08-08 02:41:59 on dist-test-slave-8tdl"
server_key: "6e3a371455b8477e8f36b145fbd1ed1e"
server_key_iv: "f4db699c6aee3810c15dce5cecb767b3"
server_key_version: "encryptionkey@0"
I20260808 02:41:59.208988 26939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "31e29a00c1474f64b3d87cc15695afb0"
format_stamp: "Formatted at 2026-08-08 02:41:59 on dist-test-slave-8tdl"
server_key: "6e3a371455b8477e8f36b145fbd1ed1e"
server_key_iv: "f4db699c6aee3810c15dce5cecb767b3"
server_key_version: "encryptionkey@0"
I20260808 02:41:59.215216 26939 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:41:59.219705 26954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:59.221691 26939 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:41:59.221922 26939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "31e29a00c1474f64b3d87cc15695afb0"
format_stamp: "Formatted at 2026-08-08 02:41:59 on dist-test-slave-8tdl"
server_key: "6e3a371455b8477e8f36b145fbd1ed1e"
server_key_iv: "f4db699c6aee3810c15dce5cecb767b3"
server_key_version: "encryptionkey@0"
I20260808 02:41:59.222177 26939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:41:59.243587 26939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:41:59.248796 26939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:41:59.249164 26939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:41:59.250303 26939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:41:59.252091 26939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:41:59.252175 26939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:59.252323 26939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:41:59.252382 26939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:41:59.290798 26939 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:45637
I20260808 02:41:59.290933 27069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:45637 every 8 connection(s)
I20260808 02:41:59.292169 26939 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:41:59.301177 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 26939
I20260808 02:41:59.301409 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:41:59.301909 10321 external_mini_cluster.cc:1428] Setting key 44101d3e7f926d54a51c9b6fd1fbc734
Aug 08 02:41:59 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156919, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:41:59.315871 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.295209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:51935 (local address 127.10.20.126:39989)
0808 02:41:59.295816 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.295820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.297021 (+ 1201us) server_negotiation.cc:407] Connection header received
0808 02:41:59.299243 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.299249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.299358 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.299491 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:59.301178 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.302213 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.304400 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.304879 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.305025 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.308947 (+ 3922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:59.308954 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:59.308957 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:59.308996 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:59.312077 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:59.313044 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:59.313053 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:59.313060 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:59.313220 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:59.313736 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:59.313743 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:59.313751 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:59.314080 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:59.314269 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.315182 (+ 913us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.315457 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":325,"threads_started":1}
I20260808 02:41:59.317160 27073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.295865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:51935)
0808 02:41:59.296800 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:59.296848 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:59.298913 (+ 2065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:59.299770 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:59.299779 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:59.300350 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:41:59.300969 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.300987 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.302418 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.302423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.304239 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.304254 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.305150 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.305159 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.305418 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.306165 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:41:59.306196 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:41:59.308658 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:41:59.312271 (+ 3613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:59.312282 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:59.312303 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:59.312857 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:59.313352 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:41:59.313357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:41:59.313361 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:41:59.313597 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:41:59.314231 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:41:59.314240 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:41:59.314733 (+ 493us) client_negotiation.cc:769] Sending connection context
0808 02:41:59.315075 (+ 342us) client_negotiation.cc:240] Negotiation successful
0808 02:41:59.315692 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":429,"threads_started":1}
I20260808 02:41:59.319041 27070 heartbeater.cc:347] Connected to a master server at 127.10.20.126:39989
I20260808 02:41:59.319401 27070 heartbeater.cc:464] Registering TS with master...
I20260808 02:41:59.320242 27070 heartbeater.cc:511] Master 127.10.20.126:39989 requested a full tablet report, sending...
I20260808 02:41:59.321882 26598 ts_manager.cc:194] Registered new tserver with Master: 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637)
I20260808 02:41:59.322796 26598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:51935
I20260808 02:41:59.331779 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:41:59.352775 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.337223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55106 (local address 127.10.20.126:39989)
0808 02:41:59.337425 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.337430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.337961 (+ 531us) server_negotiation.cc:407] Connection header received
0808 02:41:59.338199 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.338206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.338303 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.338427 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:59.340262 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.341095 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.342756 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.343224 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.343390 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.346270 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:59.346276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:59.346279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:59.346322 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:59.349428 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:59.350309 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:59.350322 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:59.350325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:59.350485 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:59.351033 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:59.351039 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:59.351044 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:59.351437 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:59.351742 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.352119 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.352416 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:41:59.358644 26598 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:41:59.366106 26598 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:41:59.397747 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.381819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56480 (local address 127.10.20.66:36721)
0808 02:41:59.382646 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.382654 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.383547 (+ 893us) server_negotiation.cc:407] Connection header received
0808 02:41:59.384072 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.384085 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.384413 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.384636 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:59.385815 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.388095 (+ 2280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.393250 (+ 5155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.395365 (+ 2115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.395529 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.395776 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.397323 (+ 1547us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.397496 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":929,"threads_started":1}
I20260808 02:41:59.398131 27085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.381807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36721 (local address 127.0.0.1:56480)
0808 02:41:59.383349 (+ 1542us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:59.383413 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:59.383748 (+ 335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:59.385061 (+ 1313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:59.385072 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:59.385110 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:59.385596 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.385611 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.388419 (+ 2808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.388429 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.391936 (+ 3507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.391975 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.395743 (+ 3768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.395754 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.396070 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.396152 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 02:41:59.396369 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 02:41:59.396628 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1198,"thread_start_us":10577,"threads_started":1}
I20260808 02:41:59.402467 26865 tablet_service.cc:1467] Processing CreateTablet for tablet c62521d2914044389356eb1eb53d6fb1 (DEFAULT_TABLE table=test-table [id=00e4093512014b84808aa631a957436d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:59.404393 26865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c62521d2914044389356eb1eb53d6fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:59.404546 27086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.381926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:53302)
0808 02:41:59.392802 (+ 10876us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:59.392831 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:59.393006 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:59.396004 (+ 2998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:59.396009 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:59.396050 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:59.396603 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.396619 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.398741 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.398747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.401105 (+ 2358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.401124 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.403536 (+ 2412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.403547 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.403737 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.403774 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:41:59.403901 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 02:41:59.404079 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10671,"mutex_wait_us":4,"thread_start_us":927,"threads_started":1}
I20260808 02:41:59.404887 27089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.384560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.10.20.67:45637)
0808 02:41:59.393511 (+ 8951us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.393527 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.394392 (+ 865us) server_negotiation.cc:407] Connection header received
0808 02:41:59.394528 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.394541 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.394972 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.395256 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:59.396154 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.398303 (+ 2149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.401829 (+ 3526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.403676 (+ 1847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.403830 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.404084 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.404367 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.404544 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8693,"thread_start_us":8488,"threads_started":1}
I20260808 02:41:59.405144 27088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.383869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:45637 (local address 127.0.0.1:37496)
0808 02:41:59.394056 (+ 10187us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:59.394078 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:59.394234 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:59.395260 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:59.395266 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:59.395300 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:59.395870 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.395882 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.399601 (+ 3719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.399608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.401636 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.401647 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.403935 (+ 2288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.403942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.404170 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.404194 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 02:41:59.404312 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 02:41:59.404461 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10049,"mutex_wait_us":3,"thread_start_us":9871,"threads_started":1}
I20260808 02:41:59.405193 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.382511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53302 (local address 127.10.20.65:41481)
0808 02:41:59.395188 (+ 12677us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.395199 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.395228 (+ 29us) server_negotiation.cc:407] Connection header received
0808 02:41:59.395336 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.395349 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.395713 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.396003 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:59.396817 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.398532 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.401348 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.402945 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.403105 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.403363 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.404674 (+ 1311us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.404856 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12450,"thread_start_us":12263,"threads_started":1}
I20260808 02:41:59.409312 26726 tablet_service.cc:1467] Processing CreateTablet for tablet c62521d2914044389356eb1eb53d6fb1 (DEFAULT_TABLE table=test-table [id=00e4093512014b84808aa631a957436d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:59.409736 27003 tablet_service.cc:1467] Processing CreateTablet for tablet c62521d2914044389356eb1eb53d6fb1 (DEFAULT_TABLE table=test-table [id=00e4093512014b84808aa631a957436d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:41:59.411425 26726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c62521d2914044389356eb1eb53d6fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:59.411427 27003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c62521d2914044389356eb1eb53d6fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:41:59.422945 27090 tablet_bootstrap.cc:492] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Bootstrap starting.
I20260808 02:41:59.425247 27091 tablet_bootstrap.cc:492] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Bootstrap starting.
I20260808 02:41:59.428192 27090 tablet_bootstrap.cc:654] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:59.429329 27090 log.cc:824] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:59.429608 27091 tablet_bootstrap.cc:654] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:59.431162 27091 log.cc:824] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:59.432700 27090 tablet_bootstrap.cc:492] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: No bootstrap required, opened a new log
I20260808 02:41:59.433015 27090 ts_tablet_manager.cc:1397] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:41:59.434231 27091 tablet_bootstrap.cc:492] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: No bootstrap required, opened a new log
I20260808 02:41:59.434499 27091 ts_tablet_manager.cc:1397] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:41:59.441279 27090 raft_consensus.cc:348] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.441730 27090 raft_consensus.cc:374] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:59.441854 27090 raft_consensus.cc:729] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842965708973470f93d1550bb8a9c0c6, State: Initialized, Role: FOLLOWER
I20260808 02:41:59.441907 27092 tablet_bootstrap.cc:492] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Bootstrap starting.
I20260808 02:41:59.442026 27091 raft_consensus.cc:348] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.442505 27091 raft_consensus.cc:374] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:59.442641 27091 raft_consensus.cc:729] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c86186cc26746d99b1b06e1d98a613f, State: Initialized, Role: FOLLOWER
I20260808 02:41:59.442597 27090 consensus_queue.cc:260] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.443241 27091 consensus_queue.cc:260] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.445089 27091 ts_tablet_manager.cc:1428] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Time spent starting tablet: real 0.010s user 0.008s sys 0.004s
I20260808 02:41:59.446393 26933 heartbeater.cc:503] Master 127.10.20.126:39989 was elected leader, sending a full tablet report...
I20260808 02:41:59.447028 27092 tablet_bootstrap.cc:654] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Neither blocks nor log segments found. Creating new log.
I20260808 02:41:59.448511 27092 log.cc:824] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:41:59.448881 27090 ts_tablet_manager.cc:1428] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260808 02:41:59.452706 27092 tablet_bootstrap.cc:492] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: No bootstrap required, opened a new log
I20260808 02:41:59.453029 27092 ts_tablet_manager.cc:1397] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.000s
I20260808 02:41:59.462397 27092 raft_consensus.cc:348] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.462942 27092 raft_consensus.cc:374] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:41:59.463055 27092 raft_consensus.cc:729] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e29a00c1474f64b3d87cc15695afb0, State: Initialized, Role: FOLLOWER
I20260808 02:41:59.463704 27092 consensus_queue.cc:260] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.464917 27070 heartbeater.cc:503] Master 127.10.20.126:39989 was elected leader, sending a full tablet report...
I20260808 02:41:59.465409 27092 ts_tablet_manager.cc:1428] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
W20260808 02:41:59.544171 27071 tablet.cc:2369] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:41:59.546988 26795 tablet.cc:2369] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:41:59.663142 26934 tablet.cc:2369] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:41:59.673373 27096 raft_consensus.cc:482] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:41:59.673748 27096 raft_consensus.cc:504] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.676262 27096 leader_election.cc:288] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 842965708973470f93d1550bb8a9c0c6 (127.10.20.66:36721), 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637)
I20260808 02:41:59.685160 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.676860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:59471 (local address 127.10.20.66:36721)
0808 02:41:59.677095 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.677105 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.677975 (+ 870us) server_negotiation.cc:407] Connection header received
0808 02:41:59.678206 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.678215 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.678302 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.678385 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:59.679359 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.680263 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.683021 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.683966 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.684221 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.684328 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.684679 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.684838 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 02:41:59.685551 27099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.676846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36721 (local address 127.10.20.65:59471)
0808 02:41:59.677821 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:59.677848 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:59.678008 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:59.678571 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:59.678578 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:59.678611 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:59.679172 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.679183 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.680429 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.680437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.682669 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.682776 (+ 107us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.684261 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.684268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.684471 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.684501 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 02:41:59.684640 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 02:41:59.684825 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":127,"spinlock_wait_cycles":28032,"thread_start_us":517,"threads_started":1}
I20260808 02:41:59.686080 27089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.677079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:58063 (local address 127.10.20.67:45637)
0808 02:41:59.677345 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.677355 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.678116 (+ 761us) server_negotiation.cc:407] Connection header received
0808 02:41:59.678332 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.678337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.678544 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.678663 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:41:59.679546 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.680528 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.683279 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.684669 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.684927 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.685027 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.685667 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.685816 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:41:59.686112 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.676934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:45637 (local address 127.10.20.65:58063)
0808 02:41:59.677952 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0808 02:41:59.677972 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:41:59.678142 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:41:59.678806 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:41:59.678810 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:41:59.678848 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:41:59.679241 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.679278 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.680833 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.680837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.683005 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:41:59.683023 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.684998 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.685006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:41:59.685176 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.685204 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 02:41:59.685587 (+ 383us) client_negotiation.cc:240] Negotiation successful
0808 02:41:59.685741 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"thread_start_us":628,"threads_started":1}
I20260808 02:41:59.687032 26885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62521d2914044389356eb1eb53d6fb1" candidate_uuid: "9c86186cc26746d99b1b06e1d98a613f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842965708973470f93d1550bb8a9c0c6" is_pre_election: true
I20260808 02:41:59.687441 27023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62521d2914044389356eb1eb53d6fb1" candidate_uuid: "9c86186cc26746d99b1b06e1d98a613f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e29a00c1474f64b3d87cc15695afb0" is_pre_election: true
I20260808 02:41:59.687657 26885 raft_consensus.cc:2454] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c86186cc26746d99b1b06e1d98a613f in term 0.
I20260808 02:41:59.687968 27023 raft_consensus.cc:2454] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c86186cc26746d99b1b06e1d98a613f in term 0.
I20260808 02:41:59.688720 26680 leader_election.cc:302] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 31e29a00c1474f64b3d87cc15695afb0, 842965708973470f93d1550bb8a9c0c6, 9c86186cc26746d99b1b06e1d98a613f; no voters:
I20260808 02:41:59.689245 27096 raft_consensus.cc:2781] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:41:59.689424 27096 raft_consensus.cc:482] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:41:59.689535 27096 raft_consensus.cc:3037] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:59.692015 27096 raft_consensus.cc:504] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.692785 27096 leader_election.cc:288] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [CANDIDATE]: Term 1 election: Requested vote from peers 842965708973470f93d1550bb8a9c0c6 (127.10.20.66:36721), 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637)
I20260808 02:41:59.693413 26885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62521d2914044389356eb1eb53d6fb1" candidate_uuid: "9c86186cc26746d99b1b06e1d98a613f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "842965708973470f93d1550bb8a9c0c6"
I20260808 02:41:59.693660 27023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c62521d2914044389356eb1eb53d6fb1" candidate_uuid: "9c86186cc26746d99b1b06e1d98a613f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e29a00c1474f64b3d87cc15695afb0"
I20260808 02:41:59.693706 26885 raft_consensus.cc:3037] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:59.693964 27023 raft_consensus.cc:3037] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:41:59.696738 26885 raft_consensus.cc:2454] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c86186cc26746d99b1b06e1d98a613f in term 1.
I20260808 02:41:59.696798 27023 raft_consensus.cc:2454] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c86186cc26746d99b1b06e1d98a613f in term 1.
I20260808 02:41:59.697273 26680 leader_election.cc:302] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 842965708973470f93d1550bb8a9c0c6, 9c86186cc26746d99b1b06e1d98a613f; no voters:
I20260808 02:41:59.697671 27096 raft_consensus.cc:2781] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:41:59.698299 27096 raft_consensus.cc:686] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 1 LEADER]: Becoming Leader. State: Replica: 9c86186cc26746d99b1b06e1d98a613f, State: Running, Role: LEADER
I20260808 02:41:59.698937 27096 consensus_queue.cc:237] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } }
I20260808 02:41:59.704638 26598 catalog_manager.cc:5495] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65). New cstate: current_term: 1 leader_uuid: "9c86186cc26746d99b1b06e1d98a613f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260808 02:41:59.781178 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.774772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53316 (local address 127.10.20.65:41481)
0808 02:41:59.775027 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.775043 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.775107 (+ 64us) server_negotiation.cc:407] Connection header received
0808 02:41:59.775390 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.775394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.775504 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.775678 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:41:59.776145 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.776938 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.778497 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.779000 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.779188 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.779796 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:41:59.780480 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:41:59.780646 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.780742 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.780835 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 02:41:59.790511 26885 raft_consensus.cc:1261] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Refusing update from remote peer 9c86186cc26746d99b1b06e1d98a613f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:59.790511 27023 raft_consensus.cc:1261] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Refusing update from remote peer 9c86186cc26746d99b1b06e1d98a613f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:41:59.791729 27096 consensus_queue.cc:1035] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:59.792100 27101 consensus_queue.cc:1035] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [LEADER]: Connected to new peer: Peer: permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:41:59.811677 27106 mvcc.cc:205] Tried to move back new op lower bound from 7316098743450767360 to 7316098743091240960. Current Snapshot: MvccSnapshot[applied={T|T < 7316098743450767360}]
I20260808 02:41:59.825232 26597 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:59.825634 26597 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:41:59.830264 26597 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Sending DeleteTablet for 3 replicas of tablet c62521d2914044389356eb1eb53d6fb1
I20260808 02:41:59.831765 26865 tablet_service.cc:1514] Processing DeleteTablet for tablet c62521d2914044389356eb1eb53d6fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:59 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:56480
I20260808 02:41:59.832057 26726 tablet_service.cc:1514] Processing DeleteTablet for tablet c62521d2914044389356eb1eb53d6fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:59 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:53302
I20260808 02:41:59.832293 27003 tablet_service.cc:1514] Processing DeleteTablet for tablet c62521d2914044389356eb1eb53d6fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:41:59 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:37496
I20260808 02:41:59.833436 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26662
I20260808 02:41:59.844301 27114 tablet_replica.cc:330] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: stopping tablet replica
I20260808 02:41:59.845270 27114 raft_consensus.cc:2229] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:59.846179 27114 raft_consensus.cc:2258] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:59.848357 27116 tablet_replica.cc:330] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: stopping tablet replica
I20260808 02:41:59.849751 27114 ts_tablet_manager.cc:1905] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:59.853169 27116 raft_consensus.cc:2229] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:41:59.854032 27116 raft_consensus.cc:2258] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:59.858613 27114 ts_tablet_manager.cc:1918] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:59.858970 27114 log.cc:1196] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/c62521d2914044389356eb1eb53d6fb1
I20260808 02:41:59.859721 27114 ts_tablet_manager.cc:1939] T c62521d2914044389356eb1eb53d6fb1 P 842965708973470f93d1550bb8a9c0c6: Deleting consensus metadata
I20260808 02:41:59.859647 27116 ts_tablet_manager.cc:1905] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:59.862054 26583 catalog_manager.cc:4841] TS 842965708973470f93d1550bb8a9c0c6 (127.10.20.66:36721): tablet c62521d2914044389356eb1eb53d6fb1 (table test-table [id=00e4093512014b84808aa631a957436d]) successfully deleted
I20260808 02:41:59.865731 27115 tablet_replica.cc:330] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: stopping tablet replica
I20260808 02:41:59.866456 27115 raft_consensus.cc:2229] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:41:59.867306 27115 raft_consensus.cc:2258] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:41:59.869735 27116 ts_tablet_manager.cc:1918] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:59.869997 27116 log.cc:1196] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/c62521d2914044389356eb1eb53d6fb1
I20260808 02:41:59.870311 27115 ts_tablet_manager.cc:1905] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:41:59.870812 27116 ts_tablet_manager.cc:1939] T c62521d2914044389356eb1eb53d6fb1 P 31e29a00c1474f64b3d87cc15695afb0: Deleting consensus metadata
I20260808 02:41:59.873087 26585 catalog_manager.cc:4841] TS 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637): tablet c62521d2914044389356eb1eb53d6fb1 (table test-table [id=00e4093512014b84808aa631a957436d]) successfully deleted
Aug 08 02:41:59 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:41:59.879230 27115 ts_tablet_manager.cc:1918] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:41:59.879468 27115 log.cc:1196] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/c62521d2914044389356eb1eb53d6fb1
I20260808 02:41:59.880148 27115 ts_tablet_manager.cc:1939] T c62521d2914044389356eb1eb53d6fb1 P 9c86186cc26746d99b1b06e1d98a613f: Deleting consensus metadata
I20260808 02:41:59.882197 26585 catalog_manager.cc:4841] TS 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65:41481): tablet c62521d2914044389356eb1eb53d6fb1 (table test-table [id=00e4093512014b84808aa631a957436d]) successfully deleted
I20260808 02:41:59.884919 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:41:59.834744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.10.20.65:41481)
0808 02:41:59.834957 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 02:41:59.834965 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:41:59.847579 (+ 12614us) server_negotiation.cc:407] Connection header received
0808 02:41:59.849002 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:41:59.849012 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:41:59.849137 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:41:59.849253 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:41:59.855183 (+ 5930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.856986 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.867834 (+ 10848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:41:59.868733 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:41:59.868876 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:41:59.875827 (+ 6951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:41:59.875877 (+ 50us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:41:59.875902 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:41:59.875970 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:41:59.880976 (+ 5006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:59.882236 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:59.882247 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:59.882250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:59.882468 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:41:59.883133 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:41:59.883137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:41:59.883140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:41:59.883571 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:41:59.883845 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 02:41:59.884334 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 02:41:59.884559 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:41:59.885794 26789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:41:59.994762 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26662
I20260808 02:42:00.021018 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26800
Aug 08 02:42:00 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:42:00.041689 27084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:00.022239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.10.20.66:36721)
0808 02:42:00.022485 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:00.022490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:00.022513 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:42:00.023232 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:00.023238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:00.023339 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:00.023459 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:00.024981 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:00.025762 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:00.027644 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:00.028086 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:00.028278 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:00.033484 (+ 5206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:00.033504 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:00.033523 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:00.033572 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:00.037519 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:00.038813 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:00.038822 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:00.038825 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:00.038987 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:00.039661 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:00.039668 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:00.039672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:00.040188 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:00.040558 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:00.040951 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 02:42:00.041303 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260808 02:42:00.042429 26927 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:00.137965 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26800
I20260808 02:42:00.158231 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26939
Aug 08 02:42:00 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:42:00.176911 27089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:00.159358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37508 (local address 127.10.20.67:45637)
0808 02:42:00.159555 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:00.159559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:00.159581 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:42:00.159792 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:00.159797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:00.159873 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:00.160045 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:00.161545 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:00.162327 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:00.164066 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:00.164480 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:00.164600 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:00.169832 (+ 5232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:00.169850 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:00.169867 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:00.169922 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:00.173146 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:00.174177 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:00.174187 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:00.174189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:00.174383 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:00.175077 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:00.175082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:00.175084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:00.175569 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:00.175832 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:00.176304 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 02:42:00.176516 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:42:00.178011 27065 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:00.275254 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26939
I20260808 02:42:00.296445 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 26565
I20260808 02:42:00.297780 26629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:00.415659 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 26565
I20260808 02:42:20.445020 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39989
--webserver_interface=127.10.20.126
--webserver_port=42447
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:39989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:42:20.873358 27122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:20.874006 27122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:20.874186 27122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:20.889421 27122 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 02:42:20.889634 27122 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 02:42:20.889739 27122 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 02:42:20.889869 27122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:42:20.890285 27122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:20.890528 27122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:20.890637 27122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:42:20.890784 27122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:42:20.905499 27122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:39989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=42447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:20.907299 27122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:20.909165 27122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:20.943203 27131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:20.943255 27129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:20.943226 27133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:20.944069 27122 server_base.cc:1034] running on GCE node
I20260808 02:42:20.945338 27122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:20.947403 27122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:20.948727 27122 hybrid_clock.cc:648] HybridClock initialized: now 1786156940948645 us; error 47 us; skew 500 ppm
I20260808 02:42:20.949287 27122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:20 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156940, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:20.953936 27122 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:42:20.956259 27122 webserver.cc:460] Webserver started at http://127.10.20.126:42447/ using document root <none> and password file <none>
I20260808 02:42:20.957278 27122 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:20.957490 27122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:20.965052 27122 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:42:20.969209 27140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:20.971171 27122 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:42:20.971422 27122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "aade7cf84f094955951124bc9923f5e4"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "53abc2a471317a740c194ef622f5d013"
server_key_iv: "f9e6e6a08fbd42caf0f805e673dced0f"
server_key_version: "encryptionkey@0"
I20260808 02:42:20.972640 27122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:21.024487 27122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:21.029919 27122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:21.030293 27122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:21.054260 27122 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:39989
I20260808 02:42:21.054322 27194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:39989 every 8 connection(s)
I20260808 02:42:21.056177 27122 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:42:21.060636 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27122
I20260808 02:42:21.061606 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:41481
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:39989
--webserver_port=42545
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:42:21.065119 27196 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:42:21.069437 27196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap starting.
I20260808 02:42:21.094167 27196 log.cc:824] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Log is configured to *not* fsync() on all Append() calls
I20260808 02:42:21.109225 27196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:42:21.109897 27196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap complete.
I20260808 02:42:21.120980 27196 raft_consensus.cc:348] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:21.122109 27196 raft_consensus.cc:729] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aade7cf84f094955951124bc9923f5e4, State: Initialized, Role: FOLLOWER
I20260808 02:42:21.122928 27196 consensus_queue.cc:260] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:21.123255 27196 raft_consensus.cc:388] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:42:21.123422 27196 raft_consensus.cc:482] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:42:21.123636 27196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 1 FOLLOWER]: Advancing to term 2
I20260808 02:42:21.128795 27196 raft_consensus.cc:504] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:21.129523 27196 leader_election.cc:302] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aade7cf84f094955951124bc9923f5e4; no voters:
I20260808 02:42:21.130347 27196 leader_election.cc:288] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 02:42:21.130530 27200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 02:42:21.132442 27200 raft_consensus.cc:686] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 LEADER]: Becoming Leader. State: Replica: aade7cf84f094955951124bc9923f5e4, State: Running, Role: LEADER
I20260808 02:42:21.133466 27200 consensus_queue.cc:237] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:21.134147 27196 sys_catalog.cc:564] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:42:21.137562 27201 sys_catalog.cc:455] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "aade7cf84f094955951124bc9923f5e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } } }
I20260808 02:42:21.138075 27201 sys_catalog.cc:458] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: This master's current role is: LEADER
I20260808 02:42:21.138669 27202 sys_catalog.cc:455] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aade7cf84f094955951124bc9923f5e4. Latest consensus state: current_term: 2 leader_uuid: "aade7cf84f094955951124bc9923f5e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } } }
I20260808 02:42:21.139079 27202 sys_catalog.cc:458] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: This master's current role is: LEADER
I20260808 02:42:21.152424 27206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:42:21.164613 27206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:42:21.166821 27206 catalog_manager.cc:1259] Loaded cluster ID: e7f676de962f45ef808a43a802f72e84
I20260808 02:42:21.166975 27206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:42:21.172782 27206 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:42:21.175220 27206 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Loaded TSK: 0
I20260808 02:42:21.205206 27217 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:42:21.219141 27206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Generated new TSK 1
I20260808 02:42:21.219594 27206 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:42:21.508878 27198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:21.509259 27198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:21.509446 27198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:21.517438 27198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:21.517628 27198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:21.517836 27198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:42:21.528899 27198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:41481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=42545
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:21.530839 27198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:21.532384 27198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:21.550937 27229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:21.551293 27224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:21.550899 27225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:21.552215 27198 server_base.cc:1034] running on GCE node
I20260808 02:42:21.552947 27198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:21.554203 27198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:21.555488 27198 hybrid_clock.cc:648] HybridClock initialized: now 1786156941555404 us; error 43 us; skew 500 ppm
I20260808 02:42:21.555867 27198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:21 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156941, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:21.559847 27198 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:42:21.562166 27198 webserver.cc:460] Webserver started at http://127.10.20.65:42545/ using document root <none> and password file <none>
I20260808 02:42:21.563126 27198 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:21.563323 27198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:21.570217 27198 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 02:42:21.573948 27236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:21.575997 27198 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260808 02:42:21.576313 27198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "9c86186cc26746d99b1b06e1d98a613f"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "48f60b80a80c04e8ab452b37ca534338"
server_key_iv: "baec5d1bc3dd0960128b002486f9eb5a"
server_key_version: "encryptionkey@0"
I20260808 02:42:21.577566 27198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:21.607805 27198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:21.613148 27198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:21.613498 27198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:21.614835 27198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:42:21.616395 27198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:42:21.616528 27198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:21.616672 27198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:42:21.616766 27198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:21.653795 27198 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:41481
I20260808 02:42:21.653916 27355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:41481 every 8 connection(s)
I20260808 02:42:21.655530 27198 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:42:21.662715 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27198
I20260808 02:42:21.663522 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:36721
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:39989
--webserver_port=39865
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:42:21 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156941, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:42:21.685007 27360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:21.658351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:54649)
0808 02:42:21.659215 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:21.659261 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:21.661169 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:21.663161 (+ 1992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:21.663175 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:21.663971 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:42:21.664571 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:21.664593 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:21.666369 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:21.666375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:21.667757 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:21.667775 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:21.669583 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:21.669593 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:21.669882 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:21.670825 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:42:21.670860 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:42:21.673998 (+ 3138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:42:21.679344 (+ 5346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:42:21.679354 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:42:21.679370 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:42:21.680199 (+ 829us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:42:21.680989 (+ 790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:42:21.680994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:42:21.680997 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:42:21.681228 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:42:21.682508 (+ 1280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:42:21.682516 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:42:21.683083 (+ 567us) client_negotiation.cc:769] Sending connection context
0808 02:42:21.683391 (+ 308us) client_negotiation.cc:240] Negotiation successful
0808 02:42:21.683869 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":373,"threads_started":1}
I20260808 02:42:21.685488 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:21.658330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:54649 (local address 127.10.20.126:39989)
0808 02:42:21.658952 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:21.658964 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:21.659430 (+ 466us) server_negotiation.cc:407] Connection header received
0808 02:42:21.661970 (+ 2540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:21.661990 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:21.662432 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:21.663016 (+ 584us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:21.664824 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:21.666153 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:21.667962 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:21.669188 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:21.669454 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:21.674498 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:21.674509 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:21.674528 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:21.674585 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:21.679071 (+ 4486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:21.680498 (+ 1427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:21.680512 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:21.680524 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:21.680799 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:21.681382 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:21.681390 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:21.681395 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:21.682266 (+ 871us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:21.682504 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:21.683729 (+ 1225us) server_negotiation.cc:299] Negotiation successful
0808 02:42:21.684225 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":269,"threads_started":1}
I20260808 02:42:21.688663 27357 heartbeater.cc:347] Connected to a master server at 127.10.20.126:39989
I20260808 02:42:21.689121 27357 heartbeater.cc:464] Registering TS with master...
I20260808 02:42:21.690121 27357 heartbeater.cc:511] Master 127.10.20.126:39989 requested a full tablet report, sending...
I20260808 02:42:21.693095 27158 ts_manager.cc:194] Registered new tserver with Master: 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65:41481)
I20260808 02:42:21.694965 27158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:54649
W20260808 02:42:22.054607 27361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:22.055061 27361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:22.055243 27361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:22.069033 27361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:22.069221 27361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:22.069423 27361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:42:22.086616 27361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:36721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=39865
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:22.088253 27361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:22.089766 27361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:22.107020 27370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:22.107020 27367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:22.107925 27368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:22.108991 27361 server_base.cc:1034] running on GCE node
I20260808 02:42:22.109845 27361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:22.111053 27361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:22.112351 27361 hybrid_clock.cc:648] HybridClock initialized: now 1786156942112292 us; error 55 us; skew 500 ppm
I20260808 02:42:22.112814 27361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:22 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156942, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:22.116811 27361 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:42:22.118630 27361 webserver.cc:460] Webserver started at http://127.10.20.66:39865/ using document root <none> and password file <none>
I20260808 02:42:22.119484 27361 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:22.119678 27361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:22.125833 27361 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 02:42:22.129231 27377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:22.131114 27361 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:42:22.131333 27361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "842965708973470f93d1550bb8a9c0c6"
format_stamp: "Formatted at 2026-08-08 02:41:58 on dist-test-slave-8tdl"
server_key: "4da3f2bc3e909b53343906cf3c1c7fbc"
server_key_iv: "487d4398ba51aa69976a8c40c145fe9a"
server_key_version: "encryptionkey@0"
I20260808 02:42:22.132434 27361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:22.150255 27361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:22.156212 27361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:22.156569 27361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:22.157871 27361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:42:22.159639 27361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:42:22.159785 27361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:22.159938 27361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:42:22.160045 27361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:22.201735 27361 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36721
I20260808 02:42:22.201800 27493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36721 every 8 connection(s)
I20260808 02:42:22.203569 27361 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:42:22.206981 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27361
I20260808 02:42:22.207897 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:45637
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:39989
--webserver_port=39509
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 02:42:22 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156942, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:42:22.230773 27496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.207125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:47211 (local address 127.10.20.126:39989)
0808 02:42:22.207754 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.207760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.208976 (+ 1216us) server_negotiation.cc:407] Connection header received
0808 02:42:22.211358 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.211365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.211488 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.211625 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:22.213545 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.214379 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.216358 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.216843 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.217027 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.222130 (+ 5103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:22.222141 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:22.222148 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:22.222203 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:22.226129 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.227422 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.227432 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.227438 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.227618 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.228245 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.228253 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.228259 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.228711 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:22.228912 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.229883 (+ 971us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.230223 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":360,"threads_started":1}
I20260808 02:42:22.231583 27497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.207769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:47211)
0808 02:42:22.208772 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:22.208817 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:22.210997 (+ 2180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:22.211916 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:22.211927 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:22.212554 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:42:22.213316 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.213337 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.214586 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.214604 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.216157 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.216173 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.217146 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.217157 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.217623 (+ 466us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.218464 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:42:22.218491 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:42:22.221665 (+ 3174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:42:22.226407 (+ 4742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:42:22.226417 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:42:22.226435 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:42:22.227221 (+ 786us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:42:22.227775 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:42:22.227780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:42:22.227783 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:42:22.228094 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:42:22.228928 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:42:22.228935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:42:22.229360 (+ 425us) client_negotiation.cc:769] Sending connection context
0808 02:42:22.229639 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 02:42:22.230164 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"thread_start_us":456,"threads_started":1}
I20260808 02:42:22.233775 27494 heartbeater.cc:347] Connected to a master server at 127.10.20.126:39989
I20260808 02:42:22.234187 27494 heartbeater.cc:464] Registering TS with master...
I20260808 02:42:22.235335 27494 heartbeater.cc:511] Master 127.10.20.126:39989 requested a full tablet report, sending...
I20260808 02:42:22.237519 27158 ts_manager.cc:194] Registered new tserver with Master: 842965708973470f93d1550bb8a9c0c6 (127.10.20.66:36721)
I20260808 02:42:22.238493 27158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:47211
W20260808 02:42:22.594890 27498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:22.595300 27498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:22.595480 27498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:22.603634 27498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:22.603826 27498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:22.604020 27498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:42:22.615471 27498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:45637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=39509
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:22.617164 27498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:22.618821 27498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:22.636358 27504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:22.636528 27503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:22.636376 27506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:22.643191 27498 server_base.cc:1034] running on GCE node
I20260808 02:42:22.644012 27498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:22.645231 27498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:22.646575 27498 hybrid_clock.cc:648] HybridClock initialized: now 1786156942646496 us; error 75 us; skew 500 ppm
I20260808 02:42:22.647099 27498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:22 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156942, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:22.651139 27498 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:42:22.653632 27498 webserver.cc:460] Webserver started at http://127.10.20.67:39509/ using document root <none> and password file <none>
I20260808 02:42:22.654843 27498 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:22.655051 27498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:22.661266 27498 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 02:42:22.664842 27514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:22.666818 27498 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:42:22.667083 27498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "31e29a00c1474f64b3d87cc15695afb0"
format_stamp: "Formatted at 2026-08-08 02:41:59 on dist-test-slave-8tdl"
server_key: "6e3a371455b8477e8f36b145fbd1ed1e"
server_key_iv: "f4db699c6aee3810c15dce5cecb767b3"
server_key_version: "encryptionkey@0"
I20260808 02:42:22.668220 27498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:22.700022 27357 heartbeater.cc:503] Master 127.10.20.126:39989 was elected leader, sending a full tablet report...
I20260808 02:42:22.711980 27498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:22.717099 27498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:22.717358 27498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:22.718423 27498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:42:22.720136 27498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:42:22.720242 27498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:22.720324 27498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:42:22.720381 27498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:22.761149 27498 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:45637
I20260808 02:42:22.761251 27638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:45637 every 8 connection(s)
I20260808 02:42:22.763078 27498 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:42:22.763808 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27498
Aug 08 02:42:22 dist-test-slave-8tdl krb5kdc[26552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156942, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:42:22.787086 27641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.765199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.10.20.126:39989)
0808 02:42:22.765742 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.765751 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.766109 (+ 358us) server_negotiation.cc:407] Connection header received
0808 02:42:22.766355 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.766365 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.766455 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.766593 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:22.768973 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.770272 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.772390 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.773048 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.773210 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.777611 (+ 4401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:22.777620 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:22.777625 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:22.777681 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:22.782218 (+ 4537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.783562 (+ 1344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.783572 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.783577 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.783779 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.784403 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.784409 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.784412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.784821 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:22.785032 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.785852 (+ 820us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.786392 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":273,"threads_started":1}
I20260808 02:42:22.792860 27643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.766947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:56015 (local address 127.10.20.126:39989)
0808 02:42:22.767689 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.767693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.768779 (+ 1086us) server_negotiation.cc:407] Connection header received
0808 02:42:22.771589 (+ 2810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.771595 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.771715 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.771862 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:22.774273 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.775848 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.778080 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.778914 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.779031 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.784663 (+ 5632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:22.784669 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:22.784673 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:22.784714 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:22.788932 (+ 4218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.790083 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.790091 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.790095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.790247 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.790846 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.790853 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.790856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.791170 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:22.791336 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.792165 (+ 829us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.792429 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":438,"threads_started":1}
I20260808 02:42:22.793922 27644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.767611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:56015)
0808 02:42:22.768577 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:22.768622 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:22.771249 (+ 2627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:22.772178 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:22.772188 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:22.773071 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:42:22.773930 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.773953 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.776083 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.776088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.777872 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.777893 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.779201 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.779213 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.779642 (+ 429us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.780397 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:42:22.780436 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:42:22.784285 (+ 3849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:42:22.789150 (+ 4865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:42:22.789168 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:42:22.789186 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:42:22.789907 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:42:22.790397 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:42:22.790404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:42:22.790413 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:42:22.790654 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:42:22.791331 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:42:22.791341 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:42:22.791771 (+ 430us) client_negotiation.cc:769] Sending connection context
0808 02:42:22.792060 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 02:42:22.792687 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":399,"threads_started":1}
I20260808 02:42:22.795786 27639 heartbeater.cc:347] Connected to a master server at 127.10.20.126:39989
I20260808 02:42:22.796252 27639 heartbeater.cc:464] Registering TS with master...
I20260808 02:42:22.797163 27639 heartbeater.cc:511] Master 127.10.20.126:39989 requested a full tablet report, sending...
I20260808 02:42:22.799136 27158 ts_manager.cc:194] Registered new tserver with Master: 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637)
I20260808 02:42:22.800163 27158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:56015
I20260808 02:42:22.803740 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:42:22.812461 27643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.805150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48152 (local address 127.10.20.126:39989)
0808 02:42:22.805379 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.805384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.806002 (+ 618us) server_negotiation.cc:407] Connection header received
0808 02:42:22.806292 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.806297 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.806452 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.806600 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:42:22.807255 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.808272 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.809958 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.810571 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.810800 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.811553 (+ 753us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:42:22.811861 (+ 308us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 02:42:22.812193 (+ 332us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48152: token expired
Metrics: {"server-negotiator.queue_time_us":93}
W20260808 02:42:22.812644 27643 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48152: token expired
W20260808 02:42:22.813932 27074 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.20.126:39989)
I20260808 02:42:22.831323 27643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.815050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48160 (local address 127.10.20.126:39989)
0808 02:42:22.815243 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.815248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.815266 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:42:22.815317 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.815320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.815380 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.815465 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:22.817097 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.817944 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.819795 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.820346 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.820519 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.824053 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:22.824062 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:22.824066 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:22.824116 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:22.827559 (+ 3443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.828787 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.828792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.828795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.828962 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:22.829517 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:22.829521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:22.829523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:22.829906 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:22.830138 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.830578 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.830904 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:42:22.836007 27158 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:42:22.844673 27158 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:42:22.872225 27655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.862758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52284 (local address 127.10.20.65:41481)
0808 02:42:22.864020 (+ 1262us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.864028 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.864093 (+ 65us) server_negotiation.cc:407] Connection header received
0808 02:42:22.864188 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.864197 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.864525 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.865450 (+ 925us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:42:22.865680 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.866970 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.869530 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.870937 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.871338 (+ 401us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.871584 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.871660 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.871837 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":567,"threads_started":1}
I20260808 02:42:22.872323 27654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.862065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52284)
0808 02:42:22.862610 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:22.862629 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:22.862792 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:22.864760 (+ 1968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:22.864766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:22.864817 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:42:22.865246 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.865259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.867119 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.867124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.869322 (+ 2198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.869338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.871194 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.871200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.871484 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.871520 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 02:42:22.871607 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 02:42:22.871845 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":107,"spinlock_wait_cycles":5120,"thread_start_us":1147,"threads_started":1}
I20260808 02:42:22.872576 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.861160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53514 (local address 127.10.20.66:36721)
0808 02:42:22.862485 (+ 1325us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.862500 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.862539 (+ 39us) server_negotiation.cc:407] Connection header received
0808 02:42:22.862720 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.862734 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.863103 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.863374 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:42:22.864145 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.866074 (+ 1929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.869450 (+ 3376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.870799 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.870960 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.871191 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.872034 (+ 843us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.872225 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1103,"thread_start_us":1824,"threads_started":1}
I20260808 02:42:22.873126 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.860487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:36721 (local address 127.0.0.1:53514)
0808 02:42:22.861227 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:22.861245 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:22.861372 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:22.863374 (+ 2002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:22.863382 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:22.863415 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:42:22.863910 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.863926 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.866224 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.866231 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.868811 (+ 2580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.868827 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.871077 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.871086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.871353 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.871422 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 02:42:22.871582 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 02:42:22.871838 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":43,"thread_start_us":861,"threads_started":1}
I20260808 02:42:22.874197 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.860020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54864 (local address 127.10.20.67:45637)
0808 02:42:22.864116 (+ 4096us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:22.864125 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:22.864163 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:42:22.864273 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:22.864280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:22.864522 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:22.864771 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:42:22.866068 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.867757 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.870329 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.871898 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.872051 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.873019 (+ 968us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:22.873546 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 02:42:22.873720 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3866,"thread_start_us":3663,"threads_started":1}
I20260808 02:42:22.874246 27650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:22.859514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:45637 (local address 127.0.0.1:54864)
0808 02:42:22.860710 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:22.860771 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:22.861056 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:22.864758 (+ 3702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:22.864763 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:22.864806 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:42:22.865877 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.865887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.867919 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.867926 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.870126 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:22.870141 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:22.872409 (+ 2268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:22.872415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:22.873235 (+ 820us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:22.873282 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 02:42:22.873477 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 02:42:22.873632 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":1,"spinlock_wait_cycles":3968,"thread_start_us":1781,"threads_started":1}
I20260808 02:42:22.876998 27286 tablet_service.cc:1467] Processing CreateTablet for tablet 0251d167c86149da8d080b09a56c0a54 (DEFAULT_TABLE table=test-table [id=b8f0b97443754fb3927ef35791dc8b11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:42:22.877650 27427 tablet_service.cc:1467] Processing CreateTablet for tablet 0251d167c86149da8d080b09a56c0a54 (DEFAULT_TABLE table=test-table [id=b8f0b97443754fb3927ef35791dc8b11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:42:22.878762 27286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0251d167c86149da8d080b09a56c0a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:42:22.879135 27427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0251d167c86149da8d080b09a56c0a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:42:22.879079 27567 tablet_service.cc:1467] Processing CreateTablet for tablet 0251d167c86149da8d080b09a56c0a54 (DEFAULT_TABLE table=test-table [id=b8f0b97443754fb3927ef35791dc8b11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:42:22.880573 27567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0251d167c86149da8d080b09a56c0a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:42:22.893731 27656 tablet_bootstrap.cc:492] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Bootstrap starting.
I20260808 02:42:22.896258 27657 tablet_bootstrap.cc:492] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Bootstrap starting.
I20260808 02:42:22.898887 27656 tablet_bootstrap.cc:654] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Neither blocks nor log segments found. Creating new log.
I20260808 02:42:22.899709 27658 tablet_bootstrap.cc:492] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Bootstrap starting.
I20260808 02:42:22.900693 27656 log.cc:824] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:42:22.900763 27657 tablet_bootstrap.cc:654] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Neither blocks nor log segments found. Creating new log.
I20260808 02:42:22.902594 27657 log.cc:824] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:42:22.903373 27658 tablet_bootstrap.cc:654] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Neither blocks nor log segments found. Creating new log.
I20260808 02:42:22.904592 27656 tablet_bootstrap.cc:492] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: No bootstrap required, opened a new log
I20260808 02:42:22.904734 27658 log.cc:824] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:42:22.904932 27656 ts_tablet_manager.cc:1397] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260808 02:42:22.906589 27657 tablet_bootstrap.cc:492] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: No bootstrap required, opened a new log
I20260808 02:42:22.906991 27657 ts_tablet_manager.cc:1397] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 02:42:22.908495 27658 tablet_bootstrap.cc:492] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: No bootstrap required, opened a new log
I20260808 02:42:22.908802 27658 ts_tablet_manager.cc:1397] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:42:22.916558 27658 raft_consensus.cc:348] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:22.917068 27658 raft_consensus.cc:374] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:42:22.917178 27658 raft_consensus.cc:729] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e29a00c1474f64b3d87cc15695afb0, State: Initialized, Role: FOLLOWER
I20260808 02:42:22.918351 27658 consensus_queue.cc:260] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:22.918431 27656 raft_consensus.cc:348] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:22.919016 27656 raft_consensus.cc:374] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:42:22.919154 27656 raft_consensus.cc:729] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842965708973470f93d1550bb8a9c0c6, State: Initialized, Role: FOLLOWER
I20260808 02:42:22.920464 27656 consensus_queue.cc:260] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:22.920836 27639 heartbeater.cc:503] Master 127.10.20.126:39989 was elected leader, sending a full tablet report...
I20260808 02:42:22.920477 27657 raft_consensus.cc:348] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:22.921681 27657 raft_consensus.cc:374] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:42:22.921799 27658 ts_tablet_manager.cc:1428] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260808 02:42:22.921859 27657 raft_consensus.cc:729] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c86186cc26746d99b1b06e1d98a613f, State: Initialized, Role: FOLLOWER
I20260808 02:42:22.922922 27494 heartbeater.cc:503] Master 127.10.20.126:39989 was elected leader, sending a full tablet report...
I20260808 02:42:22.922844 27657 consensus_queue.cc:260] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:22.924927 27656 ts_tablet_manager.cc:1428] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Time spent starting tablet: real 0.020s user 0.019s sys 0.000s
I20260808 02:42:22.927048 27657 ts_tablet_manager.cc:1428] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Time spent starting tablet: real 0.020s user 0.019s sys 0.000s
W20260808 02:42:22.956070 27495 tablet.cc:2369] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:42:23.016822 27640 tablet.cc:2369] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:42:23.083218 27663 raft_consensus.cc:482] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:42:23.083649 27663 raft_consensus.cc:504] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:23.085376 27663 leader_election.cc:288] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637), 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65:41481)
I20260808 02:42:23.093422 27665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.085831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:45637 (local address 127.10.20.66:40995)
0808 02:42:23.086498 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.086515 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:23.086757 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:23.087204 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:23.087209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:23.087242 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:42:23.087764 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:23.087780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.089145 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.089151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:23.090976 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:23.090990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.092480 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.092488 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:23.092687 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.092727 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 02:42:23.092839 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 02:42:23.093005 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"spinlock_wait_cycles":27392,"thread_start_us":389,"threads_started":1}
I20260808 02:42:23.093470 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.085961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:40995 (local address 127.10.20.67:45637)
0808 02:42:23.086252 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:23.086259 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:23.086705 (+ 446us) server_negotiation.cc:407] Connection header received
0808 02:42:23.086933 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:23.086940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:23.087041 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:23.087152 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:42:23.087935 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.088986 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.091158 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.092236 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.092371 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.092431 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:23.092908 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 02:42:23.093119 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:42:23.094113 27655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.086898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:36061 (local address 127.10.20.65:41481)
0808 02:42:23.087165 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:23.087170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:23.087444 (+ 274us) server_negotiation.cc:407] Connection header received
0808 02:42:23.087600 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:23.087607 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:23.087697 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:23.087814 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:42:23.088625 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.089601 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.091822 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.092897 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.093056 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.093131 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:23.093646 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 02:42:23.093856 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 02:42:23.094789 27666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.086666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.10.20.66:36061)
0808 02:42:23.087328 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.087345 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 02:42:23.087466 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:42:23.087898 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:42:23.087904 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:42:23.087999 (+ 95us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:42:23.088397 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:23.088409 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.089777 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.089781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:23.091639 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:42:23.091657 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.093192 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.093199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:42:23.093414 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.093449 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:42:23.094291 (+ 842us) client_negotiation.cc:240] Negotiation successful
0808 02:42:23.094458 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":498,"threads_started":1}
I20260808 02:42:23.094866 27588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0251d167c86149da8d080b09a56c0a54" candidate_uuid: "842965708973470f93d1550bb8a9c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e29a00c1474f64b3d87cc15695afb0" is_pre_election: true
I20260808 02:42:23.095531 27588 raft_consensus.cc:2454] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842965708973470f93d1550bb8a9c0c6 in term 0.
I20260808 02:42:23.095888 27306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0251d167c86149da8d080b09a56c0a54" candidate_uuid: "842965708973470f93d1550bb8a9c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c86186cc26746d99b1b06e1d98a613f" is_pre_election: true
I20260808 02:42:23.096395 27381 leader_election.cc:302] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e29a00c1474f64b3d87cc15695afb0, 842965708973470f93d1550bb8a9c0c6; no voters:
I20260808 02:42:23.096411 27306 raft_consensus.cc:2454] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 842965708973470f93d1550bb8a9c0c6 in term 0.
I20260808 02:42:23.096892 27663 raft_consensus.cc:2781] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:42:23.097060 27663 raft_consensus.cc:482] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:42:23.097177 27663 raft_consensus.cc:3037] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:42:23.099781 27663 raft_consensus.cc:504] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:23.100617 27663 leader_election.cc:288] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637), 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65:41481)
I20260808 02:42:23.101148 27588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0251d167c86149da8d080b09a56c0a54" candidate_uuid: "842965708973470f93d1550bb8a9c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e29a00c1474f64b3d87cc15695afb0"
I20260808 02:42:23.101182 27306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0251d167c86149da8d080b09a56c0a54" candidate_uuid: "842965708973470f93d1550bb8a9c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c86186cc26746d99b1b06e1d98a613f"
I20260808 02:42:23.101423 27588 raft_consensus.cc:3037] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:42:23.101430 27306 raft_consensus.cc:3037] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:42:23.103914 27588 raft_consensus.cc:2454] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842965708973470f93d1550bb8a9c0c6 in term 1.
I20260808 02:42:23.104130 27306 raft_consensus.cc:2454] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 842965708973470f93d1550bb8a9c0c6 in term 1.
I20260808 02:42:23.104413 27381 leader_election.cc:302] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e29a00c1474f64b3d87cc15695afb0, 842965708973470f93d1550bb8a9c0c6; no voters:
I20260808 02:42:23.104728 27663 raft_consensus.cc:2781] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:42:23.105260 27663 raft_consensus.cc:686] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 842965708973470f93d1550bb8a9c0c6, State: Running, Role: LEADER
I20260808 02:42:23.105787 27663 consensus_queue.cc:237] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } }
I20260808 02:42:23.111531 27156 catalog_manager.cc:5495] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 842965708973470f93d1550bb8a9c0c6 (127.10.20.66). New cstate: current_term: 1 leader_uuid: "842965708973470f93d1550bb8a9c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "842965708973470f93d1550bb8a9c0c6" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 36721 } health_report { overall_health: HEALTHY } } }
W20260808 02:42:23.158396 27358 tablet.cc:2369] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:42:23.181181 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.175003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53516 (local address 127.10.20.66:36721)
0808 02:42:23.175292 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:23.175299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:23.175439 (+ 140us) server_negotiation.cc:407] Connection header received
0808 02:42:23.175710 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:23.175714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:23.175800 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:23.175976 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:42:23.176400 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.177241 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.178725 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.179169 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.179318 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.179943 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:42:23.180495 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:42:23.180677 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:23.180788 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 02:42:23.180883 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260808 02:42:23.191567 27588 raft_consensus.cc:1261] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Refusing update from remote peer 842965708973470f93d1550bb8a9c0c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:42:23.191578 27306 raft_consensus.cc:1261] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Refusing update from remote peer 842965708973470f93d1550bb8a9c0c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:42:23.192725 27667 consensus_queue.cc:1035] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c86186cc26746d99b1b06e1d98a613f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:42:23.193192 27663 consensus_queue.cc:1035] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e29a00c1474f64b3d87cc15695afb0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:42:23.207381 27670 mvcc.cc:205] Tried to move back new op lower bound from 7316098839299477504 to 7316098838965760000. Current Snapshot: MvccSnapshot[applied={T|T < 7316098839299477504}]
I20260808 02:42:23.210799 27672 mvcc.cc:205] Tried to move back new op lower bound from 7316098839299477504 to 7316098838965760000. Current Snapshot: MvccSnapshot[applied={T|T < 7316098839299477504}]
I20260808 02:42:23.227679 27156 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:42:23.228009 27156 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:42:23.232143 27156 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Sending DeleteTablet for 3 replicas of tablet 0251d167c86149da8d080b09a56c0a54
I20260808 02:42:23.233670 27567 tablet_service.cc:1514] Processing DeleteTablet for tablet 0251d167c86149da8d080b09a56c0a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:42:23 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:54864
I20260808 02:42:23.233718 27427 tablet_service.cc:1514] Processing DeleteTablet for tablet 0251d167c86149da8d080b09a56c0a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:42:23 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:53514
I20260808 02:42:23.233718 27286 tablet_service.cc:1514] Processing DeleteTablet for tablet 0251d167c86149da8d080b09a56c0a54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:42:23 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:52284
I20260808 02:42:23.235093 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 27198
I20260808 02:42:23.235518 27680 tablet_replica.cc:330] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: stopping tablet replica
I20260808 02:42:23.235566 27679 tablet_replica.cc:330] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: stopping tablet replica
I20260808 02:42:23.235816 27681 tablet_replica.cc:330] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: stopping tablet replica
I20260808 02:42:23.236138 27679 raft_consensus.cc:2229] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:42:23.236778 27679 raft_consensus.cc:2258] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:42:23.237018 27681 raft_consensus.cc:2229] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:42:23.236796 27680 raft_consensus.cc:2229] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:42:23.238379 27681 raft_consensus.cc:2258] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:42:23.238638 27680 raft_consensus.cc:2258] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:42:23.239483 27679 ts_tablet_manager.cc:1905] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:42:23.241170 27681 ts_tablet_manager.cc:1905] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:42:23.247133 27679 ts_tablet_manager.cc:1918] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:42:23.247349 27679 log.cc:1196] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/0251d167c86149da8d080b09a56c0a54
I20260808 02:42:23.247968 27679 ts_tablet_manager.cc:1939] T 0251d167c86149da8d080b09a56c0a54 P 31e29a00c1474f64b3d87cc15695afb0: Deleting consensus metadata
I20260808 02:42:23.250025 27681 ts_tablet_manager.cc:1918] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:42:23.250172 27144 catalog_manager.cc:4841] TS 31e29a00c1474f64b3d87cc15695afb0 (127.10.20.67:45637): tablet 0251d167c86149da8d080b09a56c0a54 (table test-table [id=b8f0b97443754fb3927ef35791dc8b11]) successfully deleted
I20260808 02:42:23.250403 27681 log.cc:1196] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/0251d167c86149da8d080b09a56c0a54
I20260808 02:42:23.251180 27681 ts_tablet_manager.cc:1939] T 0251d167c86149da8d080b09a56c0a54 P 842965708973470f93d1550bb8a9c0c6: Deleting consensus metadata
I20260808 02:42:23.252028 27680 ts_tablet_manager.cc:1905] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:42:23.253345 27142 catalog_manager.cc:4841] TS 842965708973470f93d1550bb8a9c0c6 (127.10.20.66:36721): tablet 0251d167c86149da8d080b09a56c0a54 (table test-table [id=b8f0b97443754fb3927ef35791dc8b11]) successfully deleted
I20260808 02:42:23.257138 27655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.236966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52294 (local address 127.10.20.65:41481)
0808 02:42:23.237165 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:23.237173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:23.237194 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:42:23.237265 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:23.237271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:23.237356 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:23.237493 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:23.239707 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.240865 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.243104 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.243787 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.243926 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.248012 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:23.248037 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:23.248059 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:23.248112 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:23.253596 (+ 5484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:23.254573 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:23.254580 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:23.254583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:23.254856 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:23.255334 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:23.255339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:23.255343 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:23.255752 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:23.256098 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:23.256428 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 02:42:23.256701 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:42:23.258023 27351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:23.379215 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 27198
I20260808 02:42:23.401866 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 27361
W20260808 02:42:23.401985 27144 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:41481 (error 108)
I20260808 02:42:23.404560 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.403694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52308)
0808 02:42:23.404177 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.404314 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":229,"threads_started":1}
W20260808 02:42:23.404891 27144 catalog_manager.cc:4584] TS 9c86186cc26746d99b1b06e1d98a613f (127.10.20.65:41481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0251d167c86149da8d080b09a56c0a54: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
I20260808 02:42:23.419688 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.403168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53526 (local address 127.10.20.66:36721)
0808 02:42:23.403362 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:23.403366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:23.403385 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:42:23.403473 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:23.403478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:23.403571 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:23.403702 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:23.405644 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.406656 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.408350 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.408847 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.409016 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.412249 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:23.412267 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:23.412286 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:23.412339 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:23.416132 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:23.417146 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:23.417154 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:23.417156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:23.417327 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:23.417831 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:23.417837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:23.417842 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:23.418290 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:23.418870 (+ 580us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:23.419023 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 02:42:23.419277 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:42:23.420588 27488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:23.458626 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.458113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52310)
0808 02:42:23.458341 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.458464 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 02:42:23.459847 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.459443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52322)
0808 02:42:23.459604 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.459688 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 02:42:23.520630 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.520171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52328)
0808 02:42:23.520378 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.520476 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 02:42:23.521786 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.521385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52344)
0808 02:42:23.521565 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.521647 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 02:42:23.543044 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 27361
I20260808 02:42:23.568881 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 27498
I20260808 02:42:23.585816 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.569979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54880 (local address 127.10.20.67:45637)
0808 02:42:23.570308 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 02:42:23.570315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:42:23.570507 (+ 192us) server_negotiation.cc:407] Connection header received
0808 02:42:23.570752 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:42:23.570758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:42:23.570903 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:42:23.571030 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:42:23.572499 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.573281 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.574746 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:42:23.575186 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:42:23.575347 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:42:23.578585 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:42:23.578603 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:42:23.578620 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:42:23.578662 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:42:23.581973 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:23.583323 (+ 1350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:23.583332 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:23.583334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:23.583496 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:42:23.583959 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:42:23.583966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:42:23.583969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:42:23.584403 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:42:23.584781 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0808 02:42:23.585148 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 02:42:23.585403 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 02:42:23.586827 27634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:23.602834 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.602224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52350)
0808 02:42:23.602475 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.602577 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 02:42:23.604125 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.603627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52358)
0808 02:42:23.603870 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.603953 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260808 02:42:23.683145 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 27498
I20260808 02:42:23.705592 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 27122
I20260808 02:42:23.707141 27190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:42:23.833606 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:23.833027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41481 (local address 127.0.0.1:52368)
0808 02:42:23.833304 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:23.833422 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 02:42:23.833596 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 27122
I20260808 02:42:43.862239 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39989
--webserver_interface=127.10.20.126
--webserver_port=42447
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:39989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:42:44.251194 27689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:44.251526 27689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:44.251622 27689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:44.259222 27689 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 02:42:44.259337 27689 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 02:42:44.259377 27689 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 02:42:44.259423 27689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:42:44.259472 27689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:44.259559 27689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:44.259609 27689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:42:44.259660 27689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:42:44.269904 27689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:39989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=42447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:44.271664 27689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:44.273150 27689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:44.286790 27697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:44.287261 27689 server_base.cc:1034] running on GCE node
W20260808 02:42:44.286955 27694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:44.286955 27695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:44.288604 27689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:44.290288 27689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:44.291592 27689 hybrid_clock.cc:648] HybridClock initialized: now 1786156964291500 us; error 63 us; skew 500 ppm
I20260808 02:42:44.292109 27689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:44 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156964, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:44.296388 27689 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:42:44.298300 27689 webserver.cc:460] Webserver started at http://127.10.20.126:42447/ using document root <none> and password file <none>
I20260808 02:42:44.299289 27689 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:44.299435 27689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:44.305883 27689 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 02:42:44.309408 27705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:44.311393 27689 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:42:44.311642 27689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "aade7cf84f094955951124bc9923f5e4"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "53abc2a471317a740c194ef622f5d013"
server_key_iv: "f9e6e6a08fbd42caf0f805e673dced0f"
server_key_version: "encryptionkey@0"
I20260808 02:42:44.312834 27689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:44.345034 27689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:44.350302 27689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:44.350778 27689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:44.372884 27689 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:39989
I20260808 02:42:44.372953 27761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:39989 every 8 connection(s)
I20260808 02:42:44.374704 27689 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:42:44.381914 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27689
I20260808 02:42:44.382454 27762 sys_catalog.cc:263] Verifying existing consensus state
I20260808 02:42:44.382969 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:41481
--local_ip_for_outbound_sockets=127.10.20.65
--tserver_master_addrs=127.10.20.126:39989
--webserver_port=42545
--webserver_interface=127.10.20.65
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:42:44.386267 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap starting.
I20260808 02:42:44.412715 27762 log.cc:824] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Log is configured to *not* fsync() on all Append() calls
I20260808 02:42:44.437343 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 02:42:44.438098 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Bootstrap complete.
I20260808 02:42:44.453565 27762 raft_consensus.cc:348] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:44.455119 27762 raft_consensus.cc:729] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: aade7cf84f094955951124bc9923f5e4, State: Initialized, Role: FOLLOWER
I20260808 02:42:44.456032 27762 consensus_queue.cc:260] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:44.456380 27762 raft_consensus.cc:388] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:42:44.456576 27762 raft_consensus.cc:482] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:42:44.456811 27762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 2 FOLLOWER]: Advancing to term 3
I20260808 02:42:44.464012 27762 raft_consensus.cc:504] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:44.464821 27762 leader_election.cc:302] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aade7cf84f094955951124bc9923f5e4; no voters:
I20260808 02:42:44.465705 27762 leader_election.cc:288] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 02:42:44.465901 27766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 02:42:44.467573 27766 raft_consensus.cc:686] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [term 3 LEADER]: Becoming Leader. State: Replica: aade7cf84f094955951124bc9923f5e4, State: Running, Role: LEADER
I20260808 02:42:44.468277 27766 consensus_queue.cc:237] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } }
I20260808 02:42:44.468379 27762 sys_catalog.cc:564] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:42:44.471156 27767 sys_catalog.cc:455] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "aade7cf84f094955951124bc9923f5e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } } }
I20260808 02:42:44.471159 27768 sys_catalog.cc:455] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aade7cf84f094955951124bc9923f5e4. Latest consensus state: current_term: 3 leader_uuid: "aade7cf84f094955951124bc9923f5e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aade7cf84f094955951124bc9923f5e4" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39989 } } }
I20260808 02:42:44.471755 27767 sys_catalog.cc:458] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: This master's current role is: LEADER
I20260808 02:42:44.471751 27768 sys_catalog.cc:458] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4 [sys.catalog]: This master's current role is: LEADER
I20260808 02:42:44.484884 27772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:42:44.494580 27772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:42:44.496480 27772 catalog_manager.cc:1259] Loaded cluster ID: e7f676de962f45ef808a43a802f72e84
I20260808 02:42:44.496728 27772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:42:44.502009 27772 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:42:44.504144 27772 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Loaded TSK: 0
I20260808 02:42:44.504618 27772 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aade7cf84f094955951124bc9923f5e4: Loaded TSK: 1
F20260808 02:42:44.505960 27772 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa48b7489ad google::LogMessage::Fail() at ??:0
@ 0x7fa48b74b88a google::LogMessage::SendToLog() at ??:0
@ 0x7fa48b7484de google::LogMessage::Flush() at ??:0
@ 0x7fa48b749a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa48f4ac7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fa48f49b73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fa4a117b1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fa4a117a783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fa4a12062a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fa4a12060c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fa4a12505e9 std::function<>::operator()() at ??:0
@ 0x7fa4a117ecdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fa4a117cc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa4a1204610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fa4a1204439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fa48e394345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa48e39791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fa48e397799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fa48e372eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa49164c6db start_thread at ??:0
@ 0x7fa48a5e261f clone at ??:0
W20260808 02:42:44.880098 27764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:44.880456 27764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:44.880579 27764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:44.888909 27764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:44.889073 27764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:44.889199 27764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:42:44.901655 27764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:41481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=42545
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:44.903239 27764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:44.904806 27764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:44.920385 27810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:44.920485 27811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:44.920490 27813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:44.921815 27764 server_base.cc:1034] running on GCE node
I20260808 02:42:44.922616 27764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:44.923801 27764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:44.925096 27764 hybrid_clock.cc:648] HybridClock initialized: now 1786156964925028 us; error 48 us; skew 500 ppm
I20260808 02:42:44.925535 27764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:44 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156964, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:44.929209 27764 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:42:44.931097 27764 webserver.cc:460] Webserver started at http://127.10.20.65:42545/ using document root <none> and password file <none>
I20260808 02:42:44.931896 27764 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:44.932067 27764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:44.938489 27764 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 02:42:44.942199 27821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:44.943899 27764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:42:44.944126 27764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "9c86186cc26746d99b1b06e1d98a613f"
format_stamp: "Formatted at 2026-08-08 02:41:57 on dist-test-slave-8tdl"
server_key: "48f60b80a80c04e8ab452b37ca534338"
server_key_iv: "baec5d1bc3dd0960128b002486f9eb5a"
server_key_version: "encryptionkey@0"
I20260808 02:42:44.945179 27764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:44.959821 27764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:44.965132 27764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:44.965482 27764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:44.966645 27764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:42:44.968886 27829 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 02:42:44.975649 27829 ts_tablet_manager.cc:1852] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 02:42:44.977049 27829 ts_tablet_manager.cc:1905] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:42:44.986094 27829 ts_tablet_manager.cc:1918] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:42:44.986348 27829 log.cc:1196] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/0251d167c86149da8d080b09a56c0a54
I20260808 02:42:44.986997 27829 ts_tablet_manager.cc:1939] T 0251d167c86149da8d080b09a56c0a54 P 9c86186cc26746d99b1b06e1d98a613f: Deleting consensus metadata
I20260808 02:42:44.987447 27764 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 02:42:44.987735 27764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.019s user 0.001s sys 0.000s
I20260808 02:42:44.987890 27764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:42:44.988051 27764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:45.030436 27764 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:41481
I20260808 02:42:45.030540 27943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:41481 every 8 connection(s)
I20260808 02:42:45.032075 27764 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:42:45.037848 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:45.035720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:51525)
0808 02:42:45.036602 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:45.036868 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":354,"threads_started":1}
W20260808 02:42:45.038915 27944 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:39989 (0 consecutive failures): Network error: Failed to ping master at 127.10.20.126:39989: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
I20260808 02:42:45.040045 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:45.039548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:41095)
0808 02:42:45.039760 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:45.039843 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 02:42:45.040674 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27764
I20260808 02:42:45.041224 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:45.040817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:51901)
0808 02:42:45.040985 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:45.041080 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 02:42:45.041497 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:36721
--local_ip_for_outbound_sockets=127.10.20.66
--tserver_master_addrs=127.10.20.126:39989
--webserver_port=39865
--webserver_interface=127.10.20.66
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:42:45.041607 27944 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 02:42:45.411264 27947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:45.411603 27947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:45.411707 27947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:45.419639 27947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:45.419785 27947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:45.419910 27947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:42:45.431278 27947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:36721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=39865
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:45.432643 27947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:45.434060 27947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:45.451296 27953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:45.451359 27954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:45.451333 27956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:45.452193 27947 server_base.cc:1034] running on GCE node
I20260808 02:42:45.452963 27947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:45.454018 27947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:45.455292 27947 hybrid_clock.cc:648] HybridClock initialized: now 1786156965455235 us; error 51 us; skew 500 ppm
I20260808 02:42:45.455663 27947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:45 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156965, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:45.459123 27947 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:42:45.460843 27947 webserver.cc:460] Webserver started at http://127.10.20.66:39865/ using document root <none> and password file <none>
I20260808 02:42:45.461591 27947 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:45.461701 27947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:45.467721 27947 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 02:42:45.471205 27965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:45.473095 27947 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260808 02:42:45.473311 27947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "842965708973470f93d1550bb8a9c0c6"
format_stamp: "Formatted at 2026-08-08 02:41:58 on dist-test-slave-8tdl"
server_key: "4da3f2bc3e909b53343906cf3c1c7fbc"
server_key_iv: "487d4398ba51aa69976a8c40c145fe9a"
server_key_version: "encryptionkey@0"
I20260808 02:42:45.474622 27947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:45.492547 27947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:45.497365 27947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:45.497642 27947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:45.498891 27947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:42:45.500344 27947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:42:45.500458 27947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:45.500553 27947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:42:45.500615 27947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:45.538086 27947 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:36721
I20260808 02:42:45.538139 28088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:36721 every 8 connection(s)
I20260808 02:42:45.539736 27947 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:42:45.545374 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:45.543360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:39245)
0808 02:42:45.544228 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:45.544475 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":313,"threads_started":1}
W20260808 02:42:45.546195 28089 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:39989 (0 consecutive failures): Network error: Failed to ping master at 127.10.20.126:39989: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
I20260808 02:42:45.547281 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:45.546865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:34031)
0808 02:42:45.547099 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:45.547168 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260808 02:42:45.548478 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:45.548055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:36269)
0808 02:42:45.548226 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:45.548323 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 02:42:45.548781 28089 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 02:42:45.550062 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 27947
I20260808 02:42:45.550760 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:45637
--local_ip_for_outbound_sockets=127.10.20.67
--tserver_master_addrs=127.10.20.126:39989
--webserver_port=39509
--webserver_interface=127.10.20.67
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:42:45.925668 28092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:42:45.926005 28092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:42:45.926151 28092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:42:45.934147 28092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:42:45.934301 28092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:42:45.934552 28092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:42:45.945117 28092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:45637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=39509
--tserver_master_addrs=127.10.20.126:39989
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:42:45.946591 28092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:42:45.948136 28092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:42:45.962836 28097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:45.962898 28100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:42:45.962795 28098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:42:45.963949 28092 server_base.cc:1034] running on GCE node
I20260808 02:42:45.964617 28092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:42:45.965752 28092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:42:45.966998 28092 hybrid_clock.cc:648] HybridClock initialized: now 1786156965966924 us; error 63 us; skew 500 ppm
I20260808 02:42:45.967336 28092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:42:45 dist-test-slave-8tdl krb5kdc[26552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156965, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:42:45.974378 28092 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:42:45.976446 28092 webserver.cc:460] Webserver started at http://127.10.20.67:39509/ using document root <none> and password file <none>
I20260808 02:42:45.977377 28092 fs_manager.cc:359] Metadata directory not provided
I20260808 02:42:45.977546 28092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:42:45.983815 28092 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:42:45.987401 28108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:45.989060 28092 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260808 02:42:45.989398 28092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "31e29a00c1474f64b3d87cc15695afb0"
format_stamp: "Formatted at 2026-08-08 02:41:59 on dist-test-slave-8tdl"
server_key: "6e3a371455b8477e8f36b145fbd1ed1e"
server_key_iv: "f4db699c6aee3810c15dce5cecb767b3"
server_key_version: "encryptionkey@0"
I20260808 02:42:45.990504 28092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:42:46.025534 28092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:42:46.031024 28092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:42:46.031348 28092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:42:46.032478 28092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:42:46.034098 28092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:42:46.034227 28092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:46.034369 28092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:42:46.034462 28092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:42:46.043551 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:46.042442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:39073)
0808 02:42:46.043026 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:46.043167 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":301,"threads_started":1}
I20260808 02:42:46.072172 28092 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:45637
I20260808 02:42:46.072294 28226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:45637 every 8 connection(s)
I20260808 02:42:46.073725 28092 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:42:46.077749 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28092
I20260808 02:42:46.079638 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:46.076989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:49963)
0808 02:42:46.077946 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:46.078242 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":402,"threads_started":1}
W20260808 02:42:46.080497 28227 heartbeater.cc:644] Failed to heartbeat to 127.10.20.126:39989 (0 consecutive failures): Network error: Failed to ping master at 127.10.20.126:39989: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
I20260808 02:42:46.081656 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:46.081165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:58373)
0808 02:42:46.081404 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:46.081530 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 02:42:46.082940 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:46.082466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:59565)
0808 02:42:46.082659 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:46.082798 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260808 02:42:46.083264 28227 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 02:42:46.550724 28231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:46.549551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:36525)
0808 02:42:46.550238 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:46.550366 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":340,"threads_started":1}
I20260808 02:42:47.045926 28232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:47.044992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:58395)
0808 02:42:47.045516 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:47.045676 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":279,"threads_started":1}
I20260808 02:42:47.085146 28233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:47.084130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:40433)
0808 02:42:47.084779 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:47.084884 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":341,"threads_started":1}
I20260808 02:42:47.552735 28234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:47.551819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:39861)
0808 02:42:47.552453 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:47.552552 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":372,"threads_started":1}
I20260808 02:42:48.048293 28236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:48.047336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:44479)
0808 02:42:48.048008 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:48.048101 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":368,"threads_started":1}
I20260808 02:42:48.087324 28237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:48.086394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:57621)
0808 02:42:48.087035 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:48.087141 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":287,"threads_started":1}
I20260808 02:42:48.554934 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:48.553876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:56277)
0808 02:42:48.554445 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:48.554631 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":298,"threads_started":1}
I20260808 02:42:49.050505 28239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:49.049522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:48379)
0808 02:42:49.050181 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:49.050323 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":282,"threads_started":1}
I20260808 02:42:49.089331 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:49.088501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:58571)
0808 02:42:49.089042 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:49.089145 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":277,"threads_started":1}
I20260808 02:42:49.556839 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:49.556044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:60385)
0808 02:42:49.556544 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:49.556636 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":250,"threads_started":1}
I20260808 02:42:50.052619 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:50.051775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:48619)
0808 02:42:50.052282 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:50.052427 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":269,"threads_started":1}
I20260808 02:42:50.091415 28243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:50.090456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:57713)
0808 02:42:50.091125 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:50.091226 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":354,"threads_started":1}
I20260808 02:42:50.559010 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:50.558052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:50407)
0808 02:42:50.558670 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:50.558815 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":347,"threads_started":1}
I20260808 02:42:51.054909 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:51.053882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:49797)
0808 02:42:51.054510 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:51.054628 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":302,"threads_started":1}
I20260808 02:42:51.093550 28246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:51.092631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:38175)
0808 02:42:51.093268 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:51.093358 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":383,"threads_started":1}
I20260808 02:42:51.560878 28247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:51.560039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:37139)
0808 02:42:51.560548 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:51.560668 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":260,"threads_started":1}
I20260808 02:42:52.057003 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:52.056038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:36437)
0808 02:42:52.056658 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:52.056753 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":271,"threads_started":1}
I20260808 02:42:52.095955 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:52.094985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:46089)
0808 02:42:52.095591 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:52.095741 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":314,"threads_started":1}
I20260808 02:42:52.563355 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:52.562343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:37349)
0808 02:42:52.563031 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:52.563130 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":360,"threads_started":1}
I20260808 02:42:53.059415 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:53.058322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:36211)
0808 02:42:53.059112 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:53.059231 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":485,"threads_started":1}
I20260808 02:42:53.098336 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:53.097336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:48787)
0808 02:42:53.097977 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:53.098090 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":264,"threads_started":1}
I20260808 02:42:53.565483 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:53.564466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:44641)
0808 02:42:53.565134 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:53.565265 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":339,"threads_started":1}
I20260808 02:42:54.061466 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:54.060558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:58007)
0808 02:42:54.061175 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:54.061281 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":300,"threads_started":1}
I20260808 02:42:54.100340 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:54.099525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:40943)
0808 02:42:54.100064 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:54.100163 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":253,"threads_started":1}
I20260808 02:42:54.567495 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:54.566557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:44391)
0808 02:42:54.567192 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:54.567284 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":370,"threads_started":1}
I20260808 02:42:55.063709 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:55.062792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:40537)
0808 02:42:55.063424 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:55.063525 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":341,"threads_started":1}
I20260808 02:42:55.102459 28260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:55.101404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:33091)
0808 02:42:55.101968 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:55.102116 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":275,"threads_started":1}
I20260808 02:42:55.569520 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:55.568662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:45739)
0808 02:42:55.569199 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:55.569300 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":275,"threads_started":1}
I20260808 02:42:56.065646 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:56.064838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:49557)
0808 02:42:56.065361 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:56.065444 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":304,"threads_started":1}
I20260808 02:42:56.104559 28263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:56.103776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:35307)
0808 02:42:56.104263 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:56.104381 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":261,"threads_started":1}
I20260808 02:42:56.571480 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:56.570675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:47389)
0808 02:42:56.571180 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:56.571277 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":232,"threads_started":1}
I20260808 02:42:57.067740 28265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:57.066832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:48387)
0808 02:42:57.067444 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:57.067545 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":368,"threads_started":1}
I20260808 02:42:57.106756 28266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:57.105772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:49217)
0808 02:42:57.106371 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:57.106481 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":349,"threads_started":1}
I20260808 02:42:57.573623 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:57.572826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:48129)
0808 02:42:57.573357 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:57.573451 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":292,"threads_started":1}
I20260808 02:42:58.069851 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:58.068797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:40253)
0808 02:42:58.069504 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:58.069626 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":334,"threads_started":1}
I20260808 02:42:58.109074 28269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:58.108198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:50527)
0808 02:42:58.108731 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:58.108829 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":285,"threads_started":1}
I20260808 02:42:58.575825 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:58.574968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:52415)
0808 02:42:58.575508 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:58.575626 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":269,"threads_started":1}
I20260808 02:42:59.072062 28271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:59.071205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:46311)
0808 02:42:59.071719 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:59.071816 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":266,"threads_started":1}
I20260808 02:42:59.111557 28272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:59.110438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:45119)
0808 02:42:59.111207 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:59.111337 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":371,"threads_started":1}
I20260808 02:42:59.577679 28273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:42:59.576861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:34765)
0808 02:42:59.577391 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 02:42:59.577480 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":288,"threads_started":1}
I20260808 02:43:00.074788 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:00.073658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:56293)
0808 02:43:00.074423 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:00.074535 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":387,"threads_started":1}
I20260808 02:43:00.113590 28275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:00.112696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:50303)
0808 02:43:00.113179 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:00.113272 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":251,"threads_started":1}
I20260808 02:43:00.580041 28276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:00.579119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.66:42053)
0808 02:43:00.579704 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:00.579826 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":328,"threads_started":1}
I20260808 02:43:01.076901 28278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:01.075919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.65:35055)
0808 02:43:01.076654 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:01.076741 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":278,"threads_started":1}
I20260808 02:43:01.091975 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 27764
I20260808 02:43:01.115923 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:01.114985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:39989 (local address 127.10.20.67:54059)
0808 02:43:01.115528 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:01.115630 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.126:39989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":289,"threads_started":1}
I20260808 02:43:01.121233 28279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:01.093404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56806 (local address 127.10.20.65:41481)
0808 02:43:01.094173 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:01.094193 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:01.094244 (+ 51us) server_negotiation.cc:407] Connection header received
0808 02:43:01.096996 (+ 2752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:01.097015 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:01.097701 (+ 686us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:01.098202 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:01.100647 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:01.102963 (+ 2316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:01.105078 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:01.106196 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:01.106433 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:01.110465 (+ 4032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:01.110477 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:01.110501 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:01.110563 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:01.115745 (+ 5182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:01.116884 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:01.116895 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:01.116908 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:01.117179 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:01.117905 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:01.117912 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:01.117917 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:01.118904 (+ 987us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:01.119247 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:01.119920 (+ 673us) server_negotiation.cc:299] Negotiation successful
0808 02:43:01.120664 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":357,"threads_started":1}
I20260808 02:43:01.122877 27939 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:01.214015 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 27764
I20260808 02:43:01.236166 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 27947
I20260808 02:43:01.257359 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:01.237448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52076 (local address 127.10.20.66:36721)
0808 02:43:01.238093 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:01.238107 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:01.238145 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:43:01.239923 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:01.239935 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:01.240420 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:01.240751 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:01.242339 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:01.243944 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:01.245444 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:01.246197 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:01.246352 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:01.249955 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:01.249964 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:01.249992 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:01.250045 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:01.253601 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:01.254534 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:01.254542 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:01.254550 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:01.254831 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:01.255265 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:01.255268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:01.255270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:01.255863 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:01.256154 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:01.256629 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 02:43:01.257046 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":288,"threads_started":1}
I20260808 02:43:01.259227 28084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:01.347039 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 27947
I20260808 02:43:01.370064 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28092
I20260808 02:43:01.391155 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:01.371419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33444 (local address 127.10.20.67:45637)
0808 02:43:01.372006 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:01.372021 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:01.372067 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:43:01.374011 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:01.374025 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:01.374520 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:01.375013 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:01.376633 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:01.377918 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:01.379380 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:01.380105 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:01.380316 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:01.383322 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:01.383331 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:01.383350 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:01.383411 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:01.387088 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:01.387974 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:01.387990 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:01.387998 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:01.388207 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:01.388661 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:01.388667 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:01.388671 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:01.389307 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:01.389683 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:01.390172 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 02:43:01.390793 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":273,"threads_started":1}
I20260808 02:43:01.392792 28222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:01.483712 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28092
2026-08-08T02:43:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66306 ms)
[----------] 30 tests from SecurityITest (347827 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:01 dist-test-slave-8tdl krb5kdc[28288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:01 dist-test-slave-8tdl krb5kdc[28288](info): set up 2 sockets
Aug 08 02:43:01 dist-test-slave-8tdl krb5kdc[28288](info): commencing operation
krb5kdc: starting...
W20260808 02:43:02.711195 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:02 dist-test-slave-8tdl krb5kdc[28288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:43:03.091289 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:45659
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:45659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:03.473547 28302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:03.473915 28302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:03.474012 28302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:03.482244 28302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:03.482395 28302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:03.482445 28302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:03.482496 28302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:03.482543 28302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:03.493276 28302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:45659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:45659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:03.494704 28302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:03.496151 28302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:03.510223 28307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:03.510160 28311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:03.510160 28308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:03.510757 28302 server_base.cc:1034] running on GCE node
I20260808 02:43:03.511875 28302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:03.513495 28302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:03.514873 28302 hybrid_clock.cc:648] HybridClock initialized: now 1786156983514793 us; error 63 us; skew 500 ppm
I20260808 02:43:03.515301 28302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:03 dist-test-slave-8tdl krb5kdc[28288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156983, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:03.519228 28302 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:43:03.521529 28302 webserver.cc:460] Webserver started at http://127.10.20.126:34627/ using document root <none> and password file <none>
I20260808 02:43:03.522295 28302 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:03.522425 28302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:03.522774 28302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:03.526122 28302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "85f165cebef44d509502609ce37c444e"
format_stamp: "Formatted at 2026-08-08 02:43:03 on dist-test-slave-8tdl"
server_key: "273f563cdfd873d1d916428fe9bce510"
server_key_iv: "fff9a56a4de5786c967e5acbcb2175eb"
server_key_version: "encryptionkey@0"
I20260808 02:43:03.527068 28302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "85f165cebef44d509502609ce37c444e"
format_stamp: "Formatted at 2026-08-08 02:43:03 on dist-test-slave-8tdl"
server_key: "273f563cdfd873d1d916428fe9bce510"
server_key_iv: "fff9a56a4de5786c967e5acbcb2175eb"
server_key_version: "encryptionkey@0"
I20260808 02:43:03.534013 28302 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.004s
I20260808 02:43:03.539681 28318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:03.541818 28302 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260808 02:43:03.542176 28302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "85f165cebef44d509502609ce37c444e"
format_stamp: "Formatted at 2026-08-08 02:43:03 on dist-test-slave-8tdl"
server_key: "273f563cdfd873d1d916428fe9bce510"
server_key_iv: "fff9a56a4de5786c967e5acbcb2175eb"
server_key_version: "encryptionkey@0"
I20260808 02:43:03.542450 28302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:03.568603 28302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:03.574396 28302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:03.574822 28302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:03.602061 28302 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:45659
I20260808 02:43:03.602003 28374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:45659 every 8 connection(s)
I20260808 02:43:03.604383 28302 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:03.610666 28375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:03.610776 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28302
I20260808 02:43:03.611078 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:03.611807 10321 external_mini_cluster.cc:1428] Setting key 0d157c16f5f259fbf33c68a5c396cf3a
I20260808 02:43:03.627298 28375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e: Bootstrap starting.
Aug 08 02:43:03 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:03.632275 28375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:03.634294 28375 log.cc:824] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:03.639932 28375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e: No bootstrap required, opened a new log
I20260808 02:43:03.642333 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:03.614142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.10.20.126:45659)
0808 02:43:03.615136 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:03.615150 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:03.615206 (+ 56us) server_negotiation.cc:407] Connection header received
0808 02:43:03.617646 (+ 2440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:03.617682 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:03.618223 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:03.618648 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:03.620851 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:03.622560 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:03.625074 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:03.625951 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:03.626119 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:03.632229 (+ 6110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:03.632240 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:03.632264 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:03.632318 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:03.637126 (+ 4808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:03.638191 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:03.638200 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:03.638207 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:03.638426 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:03.638985 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:03.638998 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:03.639001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:03.639626 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:03.640011 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:03.640527 (+ 516us) server_negotiation.cc:299] Negotiation successful
0808 02:43:03.641111 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":466,"threads_started":1}
I20260808 02:43:03.652305 28375 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f165cebef44d509502609ce37c444e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45659 } }
I20260808 02:43:03.653052 28375 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:03.653225 28375 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f165cebef44d509502609ce37c444e, State: Initialized, Role: FOLLOWER
I20260808 02:43:03.653930 28375 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f165cebef44d509502609ce37c444e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45659 } }
I20260808 02:43:03.654264 28375 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:03.654428 28375 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:03.654627 28375 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:03.657182 28375 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f165cebef44d509502609ce37c444e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45659 } }
I20260808 02:43:03.657814 28375 leader_election.cc:302] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85f165cebef44d509502609ce37c444e; no voters:
I20260808 02:43:03.658526 28375 leader_election.cc:288] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:03.658672 28380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:03.659462 28380 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [term 1 LEADER]: Becoming Leader. State: Replica: 85f165cebef44d509502609ce37c444e, State: Running, Role: LEADER
I20260808 02:43:03.660184 28380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f165cebef44d509502609ce37c444e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45659 } }
I20260808 02:43:03.661116 28375 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:03.663731 28381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85f165cebef44d509502609ce37c444e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f165cebef44d509502609ce37c444e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45659 } } }
I20260808 02:43:03.663682 28383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85f165cebef44d509502609ce37c444e. Latest consensus state: current_term: 1 leader_uuid: "85f165cebef44d509502609ce37c444e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85f165cebef44d509502609ce37c444e" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 45659 } } }
I20260808 02:43:03.664189 28381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:03.664214 28383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:03.667174 28389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:03.672837 28389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:03.684122 28389 catalog_manager.cc:1347] Generated new cluster ID: 437085db4fb54f31bf5cf495ec960d36
I20260808 02:43:03.684281 28389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:03.709074 28389 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:03.711217 28389 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:03.726871 28389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e: Generated new TSK 0
I20260808 02:43:03.728497 28389 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:43:03.816628 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45659
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:04.192812 28405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:04.193114 28405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:04.193274 28405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:04.200989 28405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:04.201122 28405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:04.201297 28405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:43:04.211680 28405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:04.213078 28405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:04.214407 28405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:04.228822 28413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:04.228922 28411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:04.229194 28410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:04.230288 28405 server_base.cc:1034] running on GCE node
I20260808 02:43:04.231192 28405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:04.232316 28405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:04.233587 28405 hybrid_clock.cc:648] HybridClock initialized: now 1786156984233525 us; error 47 us; skew 500 ppm
I20260808 02:43:04.233963 28405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:04 dist-test-slave-8tdl krb5kdc[28288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156984, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:04.237496 28405 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:43:04.239162 28405 webserver.cc:460] Webserver started at http://127.10.20.65:34209/ using document root <none> and password file <none>
I20260808 02:43:04.239892 28405 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:04.240017 28405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:04.240309 28405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:04.243553 28405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "7933d95e930a429e81843b667787b7b5"
format_stamp: "Formatted at 2026-08-08 02:43:04 on dist-test-slave-8tdl"
server_key: "ff00ed8eb8743c802bbc2e087836ee92"
server_key_iv: "d7d01d2e4ad28ca40f7442b0316da6ee"
server_key_version: "encryptionkey@0"
I20260808 02:43:04.244346 28405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "7933d95e930a429e81843b667787b7b5"
format_stamp: "Formatted at 2026-08-08 02:43:04 on dist-test-slave-8tdl"
server_key: "ff00ed8eb8743c802bbc2e087836ee92"
server_key_iv: "d7d01d2e4ad28ca40f7442b0316da6ee"
server_key_version: "encryptionkey@0"
I20260808 02:43:04.250401 28405 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 02:43:04.254604 28420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:04.256316 28405 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:43:04.256534 28405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "7933d95e930a429e81843b667787b7b5"
format_stamp: "Formatted at 2026-08-08 02:43:04 on dist-test-slave-8tdl"
server_key: "ff00ed8eb8743c802bbc2e087836ee92"
server_key_iv: "d7d01d2e4ad28ca40f7442b0316da6ee"
server_key_version: "encryptionkey@0"
I20260808 02:43:04.256793 28405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:04.291361 28405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:04.296566 28405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:04.296962 28405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:04.298295 28405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:04.299844 28405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:04.299921 28405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:04.300010 28405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:04.300064 28405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:04.336289 28405 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:38031
I20260808 02:43:04.336349 28540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:38031 every 8 connection(s)
I20260808 02:43:04.337694 28405 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:43:04.344980 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28405
I20260808 02:43:04.345247 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:43:04.346194 10321 external_mini_cluster.cc:1428] Setting key d52ac7a4925e16aa01960422521cc4b8
Aug 08 02:43:04 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156984, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:04.363837 28543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:04.340475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:34933 (local address 127.10.20.126:45659)
0808 02:43:04.340998 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:04.341005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:04.342009 (+ 1004us) server_negotiation.cc:407] Connection header received
0808 02:43:04.344267 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:04.344272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:04.344348 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:04.344449 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:04.347056 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.348088 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.350873 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.351370 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.351500 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:04.356828 (+ 5328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:04.356837 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:04.356842 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:04.356895 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:04.359904 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:04.360943 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:04.360947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:04.360950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:04.361140 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:04.361738 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:04.361743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:04.361745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:04.362062 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:04.362246 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:04.363318 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0808 02:43:04.363559 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":233,"threads_started":1}
I20260808 02:43:04.365268 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:04.341021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45659 (local address 127.10.20.65:34933)
0808 02:43:04.341826 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:04.341870 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:04.343913 (+ 2043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:04.344791 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:04.344807 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:04.345748 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:04.346766 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:04.346796 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.348313 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.348319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:04.350602 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:04.350625 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.351670 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.351681 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:04.352111 (+ 430us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:04.353058 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:04.353098 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:04.356316 (+ 3218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:04.360091 (+ 3775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:04.360104 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:04.360127 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:04.360773 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:04.361263 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:04.361268 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:04.361271 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:04.361568 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:04.362214 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:04.362225 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:04.362822 (+ 597us) client_negotiation.cc:769] Sending connection context
0808 02:43:04.363172 (+ 350us) client_negotiation.cc:240] Negotiation successful
0808 02:43:04.363810 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":337,"threads_started":1}
I20260808 02:43:04.367308 28541 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45659
I20260808 02:43:04.367688 28541 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:04.368637 28541 heartbeater.cc:511] Master 127.10.20.126:45659 requested a full tablet report, sending...
I20260808 02:43:04.371392 28336 ts_manager.cc:194] Registered new tserver with Master: 7933d95e930a429e81843b667787b7b5 (127.10.20.65:38031)
I20260808 02:43:04.373152 28336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:34933
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:43:04.431321 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45659
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:04.798480 28547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:04.799115 28547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:04.799307 28547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:04.807516 28547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:04.807699 28547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:04.807879 28547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:43:04.818281 28547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:04.819797 28547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:04.821198 28547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:04.836107 28552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:04.836107 28553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:04.836454 28547 server_base.cc:1034] running on GCE node
W20260808 02:43:04.836133 28555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:04.837560 28547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:04.838824 28547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:04.840067 28547 hybrid_clock.cc:648] HybridClock initialized: now 1786156984840004 us; error 46 us; skew 500 ppm
I20260808 02:43:04.840499 28547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:04 dist-test-slave-8tdl krb5kdc[28288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156984, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:04.844069 28547 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:43:04.845810 28547 webserver.cc:460] Webserver started at http://127.10.20.66:44783/ using document root <none> and password file <none>
I20260808 02:43:04.846560 28547 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:04.846760 28547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:04.847146 28547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:04.850420 28547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "058752db0fbd475aa24edff3b3293979"
format_stamp: "Formatted at 2026-08-08 02:43:04 on dist-test-slave-8tdl"
server_key: "3e86490996e9757131142283824fc05d"
server_key_iv: "7f03cdf080a84e57cfc378a7f2fccbe4"
server_key_version: "encryptionkey@0"
I20260808 02:43:04.851330 28547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "058752db0fbd475aa24edff3b3293979"
format_stamp: "Formatted at 2026-08-08 02:43:04 on dist-test-slave-8tdl"
server_key: "3e86490996e9757131142283824fc05d"
server_key_iv: "7f03cdf080a84e57cfc378a7f2fccbe4"
server_key_version: "encryptionkey@0"
I20260808 02:43:04.857263 28547 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:43:04.861742 28563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:04.863540 28547 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:04.863758 28547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "058752db0fbd475aa24edff3b3293979"
format_stamp: "Formatted at 2026-08-08 02:43:04 on dist-test-slave-8tdl"
server_key: "3e86490996e9757131142283824fc05d"
server_key_iv: "7f03cdf080a84e57cfc378a7f2fccbe4"
server_key_version: "encryptionkey@0"
I20260808 02:43:04.864044 28547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:04.884124 28547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:04.889119 28547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:04.889456 28547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:04.890618 28547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:04.892270 28547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:04.892395 28547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:04.892561 28547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:04.892640 28547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:04.931286 28547 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:45247
I20260808 02:43:04.931291 28680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:45247 every 8 connection(s)
I20260808 02:43:04.932801 28547 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:43:04.939918 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28547
I20260808 02:43:04.940198 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:43:04.940699 10321 external_mini_cluster.cc:1428] Setting key 14ac6323bcc35f5b1b3e08a9a865ea77
Aug 08 02:43:04 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156984, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:04.956584 28684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:04.935874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:56421 (local address 127.10.20.126:45659)
0808 02:43:04.936398 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:04.936403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:04.937173 (+ 770us) server_negotiation.cc:407] Connection header received
0808 02:43:04.939232 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:04.939239 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:04.939336 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:04.939469 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:04.941296 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.942184 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.943984 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.944458 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.944614 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:04.949213 (+ 4599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:04.949219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:04.949223 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:04.949266 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:04.952562 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:04.953621 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:04.953626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:04.953628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:04.953779 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:04.954449 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:04.954454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:04.954456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:04.954869 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:04.955054 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:04.955869 (+ 815us) server_negotiation.cc:299] Negotiation successful
0808 02:43:04.956175 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":278,"threads_started":1}
I20260808 02:43:04.957758 28685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:04.936222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45659 (local address 127.10.20.66:56421)
0808 02:43:04.936996 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:04.937037 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:04.938931 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:04.939717 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:04.939726 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:04.940400 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:04.941097 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:04.941118 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.942381 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.942389 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:04.943809 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:04.943825 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:04.944747 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:04.944756 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:04.945047 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:04.945843 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:04.945877 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:04.948880 (+ 3003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:04.952807 (+ 3927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:04.952816 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:04.952833 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:04.953437 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:04.953918 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:04.953924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:04.953929 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:04.954277 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:04.955023 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:04.955032 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:04.955447 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 02:43:04.955746 (+ 299us) client_negotiation.cc:240] Negotiation successful
0808 02:43:04.956385 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":354,"threads_started":1}
I20260808 02:43:04.959905 28681 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45659
I20260808 02:43:04.960471 28681 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:04.961526 28681 heartbeater.cc:511] Master 127.10.20.126:45659 requested a full tablet report, sending...
I20260808 02:43:04.963544 28336 ts_manager.cc:194] Registered new tserver with Master: 058752db0fbd475aa24edff3b3293979 (127.10.20.66:45247)
I20260808 02:43:04.964442 28336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:56421
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:43:05.027661 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45659
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:43:05.377640 28541 heartbeater.cc:503] Master 127.10.20.126:45659 was elected leader, sending a full tablet report...
W20260808 02:43:05.402271 28688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:05.402647 28688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:05.402824 28688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:05.410907 28688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:05.411087 28688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:05.411267 28688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:43:05.421981 28688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:05.423588 28688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:05.425122 28688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:05.440578 28694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:05.440661 28693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:05.440661 28696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:05.441565 28688 server_base.cc:1034] running on GCE node
I20260808 02:43:05.442296 28688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:05.443492 28688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:05.444828 28688 hybrid_clock.cc:648] HybridClock initialized: now 1786156985444759 us; error 63 us; skew 500 ppm
I20260808 02:43:05.445298 28688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:05 dist-test-slave-8tdl krb5kdc[28288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156985, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:05.449594 28688 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:43:05.451601 28688 webserver.cc:460] Webserver started at http://127.10.20.67:43797/ using document root <none> and password file <none>
I20260808 02:43:05.452389 28688 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:05.452560 28688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:05.452919 28688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:05.456405 28688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02"
format_stamp: "Formatted at 2026-08-08 02:43:05 on dist-test-slave-8tdl"
server_key: "505dc0f43ee8005da65ea97d69769bd0"
server_key_iv: "87df397fde4c606d32bad64482a115fb"
server_key_version: "encryptionkey@0"
I20260808 02:43:05.457495 28688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02"
format_stamp: "Formatted at 2026-08-08 02:43:05 on dist-test-slave-8tdl"
server_key: "505dc0f43ee8005da65ea97d69769bd0"
server_key_iv: "87df397fde4c606d32bad64482a115fb"
server_key_version: "encryptionkey@0"
I20260808 02:43:05.464542 28688 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.003s
I20260808 02:43:05.468943 28703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:05.470659 28688 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 02:43:05.470955 28688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02"
format_stamp: "Formatted at 2026-08-08 02:43:05 on dist-test-slave-8tdl"
server_key: "505dc0f43ee8005da65ea97d69769bd0"
server_key_iv: "87df397fde4c606d32bad64482a115fb"
server_key_version: "encryptionkey@0"
I20260808 02:43:05.471222 28688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:05.488438 28688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:05.493785 28688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:05.494277 28688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:05.495554 28688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:05.497116 28688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:05.497208 28688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:05.497392 28688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:05.497473 28688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:05.536307 28688 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:44025
I20260808 02:43:05.536357 28828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:44025 every 8 connection(s)
I20260808 02:43:05.538121 28688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:43:05.547066 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28688
I20260808 02:43:05.547295 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:43:05.547922 10321 external_mini_cluster.cc:1428] Setting key 7a77eade14c22a778c748357435cb1fa
Aug 08 02:43:05 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156985, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:05.561611 28831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.541155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:37161 (local address 127.10.20.126:45659)
0808 02:43:05.541656 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.541663 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.542643 (+ 980us) server_negotiation.cc:407] Connection header received
0808 02:43:05.544633 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.544638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.544715 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.544826 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:05.546775 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.548032 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.549891 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.550349 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.550491 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.554628 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:05.554633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:05.554637 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:05.554753 (+ 116us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:05.557755 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:05.558612 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:05.558616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:05.558619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:05.558845 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:05.559358 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:05.559362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:05.559364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:05.559670 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:05.559794 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.560931 (+ 1137us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.561196 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":232,"threads_started":1}
I20260808 02:43:05.562908 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.541647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:45659 (local address 127.10.20.67:37161)
0808 02:43:05.542460 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:05.542506 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:05.544302 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:05.545145 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:05.545153 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:05.545760 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:05.546425 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.546517 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.548218 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.548223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.549706 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.549721 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.550606 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.550615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.550938 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.551832 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:05.551915 (+ 83us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:05.554341 (+ 2426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:05.557950 (+ 3609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:05.557960 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:05.557983 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:05.558467 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:05.558989 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:05.558993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:05.558996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:05.559219 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:05.559935 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:05.559943 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:05.560415 (+ 472us) client_negotiation.cc:769] Sending connection context
0808 02:43:05.560728 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 02:43:05.561275 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":315,"threads_started":1}
I20260808 02:43:05.564406 28829 heartbeater.cc:347] Connected to a master server at 127.10.20.126:45659
I20260808 02:43:05.564757 28829 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:05.565546 28829 heartbeater.cc:511] Master 127.10.20.126:45659 requested a full tablet report, sending...
I20260808 02:43:05.567253 28335 ts_manager.cc:194] Registered new tserver with Master: 6fc1c9a1a5cc4f7895e9b8107962eb02 (127.10.20.67:44025)
I20260808 02:43:05.568384 28335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:37161
I20260808 02:43:05.576808 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:43:05.595981 28831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.582068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37010 (local address 127.10.20.126:45659)
0808 02:43:05.582327 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.582336 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.582753 (+ 417us) server_negotiation.cc:407] Connection header received
0808 02:43:05.583019 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.583024 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.583096 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.583206 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:05.584834 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.585602 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.587087 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.587514 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.587679 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.590360 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:05.590365 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:05.590368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:05.590404 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:05.593102 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:05.593911 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:05.593918 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:05.593920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:05.594110 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:05.594521 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:05.594524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:05.594526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:05.594966 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:05.595208 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.595554 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.595741 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 02:43:05.601320 28335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:43:05.609545 28335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:43:05.651191 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.624336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.10.20.65:38031)
0808 02:43:05.641543 (+ 17207us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.641557 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.641617 (+ 60us) server_negotiation.cc:407] Connection header received
0808 02:43:05.641761 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.641770 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.642107 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.643446 (+ 1339us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:05.643722 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.645429 (+ 1707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.648323 (+ 2894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.649565 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.649733 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.650018 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.650587 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.650817 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16461,"thread_start_us":16244,"threads_started":1}
I20260808 02:43:05.651259 28845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.624029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38031 (local address 127.0.0.1:40558)
0808 02:43:05.639648 (+ 15619us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:05.639717 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:05.640058 (+ 341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:05.642467 (+ 2409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:05.642476 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:05.642518 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:05.643181 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.643200 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.645587 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.645593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.648104 (+ 2511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.648128 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.649819 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.649828 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.650252 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.650327 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 02:43:05.650511 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 02:43:05.650768 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15199,"mutex_wait_us":1,"thread_start_us":18135,"threads_started":1}
I20260808 02:43:05.652705 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.624643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54338 (local address 127.10.20.66:45247)
0808 02:43:05.641462 (+ 16819us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.641476 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.642338 (+ 862us) server_negotiation.cc:407] Connection header received
0808 02:43:05.642735 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.642745 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.643051 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.643255 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:05.644390 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.646118 (+ 1728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.649323 (+ 3205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.650942 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.651092 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.651671 (+ 579us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.652274 (+ 603us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.652426 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16586,"thread_start_us":16446,"threads_started":1}
I20260808 02:43:05.653142 28846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.624587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:45247 (local address 127.0.0.1:54338)
0808 02:43:05.642184 (+ 17597us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:05.642213 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:05.642465 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:05.643610 (+ 1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:05.643619 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:05.643656 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:05.644151 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.644170 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.646278 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.646284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.649103 (+ 2819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.649121 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.651833 (+ 2712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.651841 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.652045 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.652088 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 02:43:05.652195 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 02:43:05.652425 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17389,"mutex_wait_us":51,"thread_start_us":14414,"threads_started":1}
I20260808 02:43:05.653846 28847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.628375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38812 (local address 127.10.20.67:44025)
0808 02:43:05.634877 (+ 6502us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.634891 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.642804 (+ 7913us) server_negotiation.cc:407] Connection header received
0808 02:43:05.644237 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.644246 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.644496 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.644667 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:05.645402 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.646918 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.650375 (+ 3457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.652583 (+ 2208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.652739 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.653010 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.653289 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.653487 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6161,"thread_start_us":5908,"threads_started":1}
I20260808 02:43:05.654222 28842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.628002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:44025 (local address 127.0.0.1:38812)
0808 02:43:05.642565 (+ 14563us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:05.642598 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:05.643874 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:05.644774 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:05.644779 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:05.644809 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:05.645201 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.645214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.647193 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.647198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.650159 (+ 2961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.650175 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.652842 (+ 2667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.652851 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.653041 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.653093 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 02:43:05.653219 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 02:43:05.653815 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14381,"mutex_wait_us":155,"thread_start_us":13739,"threads_started":1}
I20260808 02:43:05.657330 28612 tablet_service.cc:1467] Processing CreateTablet for tablet b44a32db4847484ba8487a50ecc2be25 (DEFAULT_TABLE table=test-table [id=3c46165ff7324274a367d0f1b998dad0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:05.657758 28470 tablet_service.cc:1467] Processing CreateTablet for tablet b44a32db4847484ba8487a50ecc2be25 (DEFAULT_TABLE table=test-table [id=3c46165ff7324274a367d0f1b998dad0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:05.658039 28758 tablet_service.cc:1467] Processing CreateTablet for tablet b44a32db4847484ba8487a50ecc2be25 (DEFAULT_TABLE table=test-table [id=3c46165ff7324274a367d0f1b998dad0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:05.658942 28612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b44a32db4847484ba8487a50ecc2be25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:05.659389 28470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b44a32db4847484ba8487a50ecc2be25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:05.659548 28758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b44a32db4847484ba8487a50ecc2be25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:05.674917 28848 tablet_bootstrap.cc:492] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Bootstrap starting.
I20260808 02:43:05.677104 28850 tablet_bootstrap.cc:492] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Bootstrap starting.
I20260808 02:43:05.679984 28848 tablet_bootstrap.cc:654] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:05.680917 28850 tablet_bootstrap.cc:654] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:05.680900 28851 tablet_bootstrap.cc:492] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Bootstrap starting.
I20260808 02:43:05.682175 28850 log.cc:824] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:05.682176 28848 log.cc:824] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:05.685111 28851 tablet_bootstrap.cc:654] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:05.685796 28850 tablet_bootstrap.cc:492] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: No bootstrap required, opened a new log
I20260808 02:43:05.686123 28850 ts_tablet_manager.cc:1397] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 02:43:05.686448 28851 log.cc:824] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:05.686786 28848 tablet_bootstrap.cc:492] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: No bootstrap required, opened a new log
I20260808 02:43:05.687098 28848 ts_tablet_manager.cc:1397] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260808 02:43:05.690308 28851 tablet_bootstrap.cc:492] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: No bootstrap required, opened a new log
I20260808 02:43:05.690624 28851 ts_tablet_manager.cc:1397] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260808 02:43:05.697836 28850 raft_consensus.cc:348] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.698073 28848 raft_consensus.cc:348] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.698407 28850 raft_consensus.cc:374] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:05.698490 28848 raft_consensus.cc:374] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:05.698514 28850 raft_consensus.cc:729] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7933d95e930a429e81843b667787b7b5, State: Initialized, Role: FOLLOWER
I20260808 02:43:05.698596 28848 raft_consensus.cc:729] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058752db0fbd475aa24edff3b3293979, State: Initialized, Role: FOLLOWER
I20260808 02:43:05.698462 28851 raft_consensus.cc:348] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.699272 28848 consensus_queue.cc:260] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.699262 28850 consensus_queue.cc:260] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.699733 28851 raft_consensus.cc:374] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:05.699905 28851 raft_consensus.cc:729] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc1c9a1a5cc4f7895e9b8107962eb02, State: Initialized, Role: FOLLOWER
I20260808 02:43:05.700717 28851 consensus_queue.cc:260] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.702275 28681 heartbeater.cc:503] Master 127.10.20.126:45659 was elected leader, sending a full tablet report...
I20260808 02:43:05.702446 28848 ts_tablet_manager.cc:1428] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260808 02:43:05.702620 28850 ts_tablet_manager.cc:1428] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Time spent starting tablet: real 0.016s user 0.014s sys 0.004s
I20260808 02:43:05.703478 28829 heartbeater.cc:503] Master 127.10.20.126:45659 was elected leader, sending a full tablet report...
I20260808 02:43:05.704260 28851 ts_tablet_manager.cc:1428] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Time spent starting tablet: real 0.013s user 0.005s sys 0.006s
W20260808 02:43:05.790176 28830 tablet.cc:2369] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:05.835103 28856 raft_consensus.cc:482] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:43:05.835582 28856 raft_consensus.cc:504] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.837584 28856 leader_election.cc:288] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7933d95e930a429e81843b667787b7b5 (127.10.20.65:38031), 6fc1c9a1a5cc4f7895e9b8107962eb02 (127.10.20.67:44025)
W20260808 02:43:05.840734 28542 tablet.cc:2369] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:05.847635 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.838081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:57215 (local address 127.10.20.65:38031)
0808 02:43:05.838335 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.838344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.839358 (+ 1014us) server_negotiation.cc:407] Connection header received
0808 02:43:05.839568 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.839578 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.839644 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.839752 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:05.840393 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.841637 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.844638 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.846051 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.846240 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.846337 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.847187 (+ 850us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.847346 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 02:43:05.847631 28847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.838261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:45191 (local address 127.10.20.67:44025)
0808 02:43:05.838531 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.838539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.839436 (+ 897us) server_negotiation.cc:407] Connection header received
0808 02:43:05.839684 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.839688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.839758 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.839878 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:05.840713 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.841793 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.844638 (+ 2845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.846023 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.846240 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.846353 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.847184 (+ 831us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.847387 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 02:43:05.847877 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.838116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38031 (local address 127.10.20.66:57215)
0808 02:43:05.839171 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:05.839192 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:05.839399 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:05.839776 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:05.839780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:05.839815 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:05.840229 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.840240 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.841821 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.841826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.844383 (+ 2557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.844403 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.846496 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.846506 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.846846 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.846992 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 02:43:05.847122 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 02:43:05.847409 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":200,"thread_start_us":621,"threads_started":1}
I20260808 02:43:05.847900 28859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.838240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:44025 (local address 127.10.20.66:45191)
0808 02:43:05.839292 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:05.839319 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:05.839496 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:05.839912 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:05.839917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:05.839967 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:05.840506 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.840521 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.841987 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.841994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.844383 (+ 2389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:05.844403 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.846496 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.846506 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:05.846842 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.846992 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 02:43:05.847122 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 02:43:05.847336 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"mutex_wait_us":121,"thread_start_us":641,"threads_started":1}
I20260808 02:43:05.849236 28779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44a32db4847484ba8487a50ecc2be25" candidate_uuid: "058752db0fbd475aa24edff3b3293979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" is_pre_election: true
I20260808 02:43:05.849236 28492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44a32db4847484ba8487a50ecc2be25" candidate_uuid: "058752db0fbd475aa24edff3b3293979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7933d95e930a429e81843b667787b7b5" is_pre_election: true
I20260808 02:43:05.849789 28492 raft_consensus.cc:2454] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058752db0fbd475aa24edff3b3293979 in term 0.
I20260808 02:43:05.849803 28779 raft_consensus.cc:2454] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058752db0fbd475aa24edff3b3293979 in term 0.
I20260808 02:43:05.850598 28566 leader_election.cc:302] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058752db0fbd475aa24edff3b3293979, 7933d95e930a429e81843b667787b7b5; no voters:
I20260808 02:43:05.851166 28856 raft_consensus.cc:2781] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:43:05.851334 28856 raft_consensus.cc:482] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:43:05.851480 28856 raft_consensus.cc:3037] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:05.853920 28856 raft_consensus.cc:504] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.854715 28856 leader_election.cc:288] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [CANDIDATE]: Term 1 election: Requested vote from peers 7933d95e930a429e81843b667787b7b5 (127.10.20.65:38031), 6fc1c9a1a5cc4f7895e9b8107962eb02 (127.10.20.67:44025)
I20260808 02:43:05.855409 28779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44a32db4847484ba8487a50ecc2be25" candidate_uuid: "058752db0fbd475aa24edff3b3293979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02"
I20260808 02:43:05.855561 28492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44a32db4847484ba8487a50ecc2be25" candidate_uuid: "058752db0fbd475aa24edff3b3293979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7933d95e930a429e81843b667787b7b5"
I20260808 02:43:05.855691 28779 raft_consensus.cc:3037] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:05.855882 28492 raft_consensus.cc:3037] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:05.858126 28779 raft_consensus.cc:2454] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058752db0fbd475aa24edff3b3293979 in term 1.
I20260808 02:43:05.858592 28492 raft_consensus.cc:2454] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058752db0fbd475aa24edff3b3293979 in term 1.
I20260808 02:43:05.858762 28565 leader_election.cc:302] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058752db0fbd475aa24edff3b3293979, 6fc1c9a1a5cc4f7895e9b8107962eb02; no voters:
I20260808 02:43:05.859467 28856 raft_consensus.cc:2781] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:05.860071 28856 raft_consensus.cc:686] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 1 LEADER]: Becoming Leader. State: Replica: 058752db0fbd475aa24edff3b3293979, State: Running, Role: LEADER
I20260808 02:43:05.860666 28856 consensus_queue.cc:237] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } }
I20260808 02:43:05.867110 28335 catalog_manager.cc:5495] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058752db0fbd475aa24edff3b3293979 (127.10.20.66). New cstate: current_term: 1 leader_uuid: "058752db0fbd475aa24edff3b3293979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058752db0fbd475aa24edff3b3293979" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 45247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 } health_report { overall_health: UNKNOWN } } }
I20260808 02:43:05.903515 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.897375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.10.20.66:45247)
0808 02:43:05.897647 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.897655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.897676 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:43:05.897945 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.897949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.898049 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.898227 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:43:05.898622 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.899420 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.900990 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.901437 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.901593 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.902187 (+ 594us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:43:05.902808 (+ 621us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:43:05.902981 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.903093 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.903188 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:43:05.913100 28492 raft_consensus.cc:1261] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 1 FOLLOWER]: Refusing update from remote peer 058752db0fbd475aa24edff3b3293979: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:05.913093 28779 raft_consensus.cc:1261] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 1 FOLLOWER]: Refusing update from remote peer 058752db0fbd475aa24edff3b3293979: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:05.914312 28860 consensus_queue.cc:1035] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7933d95e930a429e81843b667787b7b5" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:05.914753 28856 consensus_queue.cc:1035] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc1c9a1a5cc4f7895e9b8107962eb02" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:05.929265 28863 mvcc.cc:205] Tried to move back new op lower bound from 7316099014288461824 to 7316099014090637312. Current Snapshot: MvccSnapshot[applied={T|T < 7316099014288461824}]
I20260808 02:43:05.951459 28334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:05.951836 28334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:05.957005 28334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85f165cebef44d509502609ce37c444e: Sending DeleteTablet for 3 replicas of tablet b44a32db4847484ba8487a50ecc2be25
I20260808 02:43:05.958658 28612 tablet_service.cc:1514] Processing DeleteTablet for tablet b44a32db4847484ba8487a50ecc2be25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:05 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:54338
I20260808 02:43:05.958886 28470 tablet_service.cc:1514] Processing DeleteTablet for tablet b44a32db4847484ba8487a50ecc2be25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:05 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:40558
I20260808 02:43:05.960022 28758 tablet_service.cc:1514] Processing DeleteTablet for tablet b44a32db4847484ba8487a50ecc2be25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:05 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:38812
I20260808 02:43:05.963739 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28405
I20260808 02:43:05.965842 28873 tablet_replica.cc:330] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: stopping tablet replica
I20260808 02:43:05.967610 28874 tablet_replica.cc:330] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: stopping tablet replica
I20260808 02:43:05.967228 28873 raft_consensus.cc:2229] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:05.968583 28873 raft_consensus.cc:2258] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:05.969578 28874 raft_consensus.cc:2229] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:05.970832 28872 tablet_replica.cc:330] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: stopping tablet replica
I20260808 02:43:05.970997 28874 raft_consensus.cc:2258] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:05.971442 28872 raft_consensus.cc:2229] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:43:05.972302 28872 raft_consensus.cc:2258] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:05.973987 28873 ts_tablet_manager.cc:1905] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:05.976199 28874 ts_tablet_manager.cc:1905] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:05.977614 28872 ts_tablet_manager.cc:1905] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:05.983137 28873 ts_tablet_manager.cc:1918] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:05.983366 28873 log.cc:1196] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/b44a32db4847484ba8487a50ecc2be25
I20260808 02:43:05.984084 28873 ts_tablet_manager.cc:1939] T b44a32db4847484ba8487a50ecc2be25 P 7933d95e930a429e81843b667787b7b5: Deleting consensus metadata
I20260808 02:43:05.986539 28322 catalog_manager.cc:4841] TS 7933d95e930a429e81843b667787b7b5 (127.10.20.65:38031): tablet b44a32db4847484ba8487a50ecc2be25 (table test-table [id=3c46165ff7324274a367d0f1b998dad0]) successfully deleted
Aug 08 02:43:05 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:43:05.990782 28872 ts_tablet_manager.cc:1918] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:05.990869 28874 ts_tablet_manager.cc:1918] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:05.991037 28872 log.cc:1196] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/b44a32db4847484ba8487a50ecc2be25
I20260808 02:43:05.991292 28874 log.cc:1196] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/b44a32db4847484ba8487a50ecc2be25
I20260808 02:43:05.991843 28872 ts_tablet_manager.cc:1939] T b44a32db4847484ba8487a50ecc2be25 P 058752db0fbd475aa24edff3b3293979: Deleting consensus metadata
I20260808 02:43:05.991871 28874 ts_tablet_manager.cc:1939] T b44a32db4847484ba8487a50ecc2be25 P 6fc1c9a1a5cc4f7895e9b8107962eb02: Deleting consensus metadata
I20260808 02:43:05.994063 28321 catalog_manager.cc:4841] TS 6fc1c9a1a5cc4f7895e9b8107962eb02 (127.10.20.67:44025): tablet b44a32db4847484ba8487a50ecc2be25 (table test-table [id=3c46165ff7324274a367d0f1b998dad0]) successfully deleted
I20260808 02:43:05.994463 28323 catalog_manager.cc:4841] TS 058752db0fbd475aa24edff3b3293979 (127.10.20.66:45247): tablet b44a32db4847484ba8487a50ecc2be25 (table test-table [id=3c46165ff7324274a367d0f1b998dad0]) successfully deleted
I20260808 02:43:05.996958 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:05.966974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40570 (local address 127.10.20.65:38031)
0808 02:43:05.967197 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:05.967208 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:05.973432 (+ 6224us) server_negotiation.cc:407] Connection header received
0808 02:43:05.973771 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:05.973777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:05.973868 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:05.973957 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:05.976717 (+ 2760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.978007 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.980534 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:05.981341 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:05.981467 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:05.988342 (+ 6875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:05.988360 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:05.988382 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:05.988435 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:05.993056 (+ 4621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:05.994385 (+ 1329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:05.994398 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:05.994402 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:05.994595 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:05.995117 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:05.995123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:05.995126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:05.995663 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:05.996016 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:05.996288 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 02:43:05.996544 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 02:43:05.997671 28534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:06.129951 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28405
I20260808 02:43:06.153968 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28547
Aug 08 02:43:06 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:43:06.183399 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:06.154975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54346 (local address 127.10.20.66:45247)
0808 02:43:06.155180 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:06.155187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:06.155309 (+ 122us) server_negotiation.cc:407] Connection header received
0808 02:43:06.155535 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:06.155546 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:06.155617 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:06.155732 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:06.157115 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:06.157998 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:06.159465 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:06.159948 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:06.160103 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:06.175055 (+ 14952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:06.175076 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:06.175094 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:06.175154 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:06.178879 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:06.179871 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:06.179881 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:06.179883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:06.180066 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:06.180533 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:06.180538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:06.180540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:06.180941 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:06.181780 (+ 839us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:06.182136 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 02:43:06.182972 (+ 836us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 02:43:06.184222 28675 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:06.304919 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28547
I20260808 02:43:06.327348 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28688
Aug 08 02:43:06 dist-test-slave-8tdl krb5kdc[28288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:43:06.345767 28847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:06.328285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38828 (local address 127.10.20.67:44025)
0808 02:43:06.328538 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:06.328542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:06.328562 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:43:06.328623 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:06.328627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:06.328691 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:06.328787 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:06.330316 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:06.331607 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:06.333163 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:06.333607 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:06.333719 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:06.338495 (+ 4776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:06.338513 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:06.338530 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:06.338580 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:06.341775 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:06.342808 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:06.342817 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:06.342820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:06.343070 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:06.343532 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:06.343536 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:06.343538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:06.343936 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:06.344231 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:06.345100 (+ 869us) server_negotiation.cc:299] Negotiation successful
0808 02:43:06.345455 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 02:43:06.346655 28824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:06.443082 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28688
I20260808 02:43:06.465651 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28302
I20260808 02:43:06.467092 28370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:06.583765 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28302
2026-08-08T02:43:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5108 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T02:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:06Z Disabled control of system clock
I20260808 02:43:06.695766 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42813
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:39709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:42813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:43:07.069415 28884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:07.069779 28884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:07.069868 28884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:07.077678 28884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:07.077821 28884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:07.077862 28884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:07.077975 28884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:07.078049 28884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:07.088156 28884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:42813
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:07.089623 28884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:07.092069 28884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:07.104601 28890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:07.104679 28892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:07.104563 28889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:07.106236 28884 server_base.cc:1034] running on GCE node
I20260808 02:43:07.107299 28884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:07.109014 28884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:07.110316 28884 hybrid_clock.cc:648] HybridClock initialized: now 1786156987110255 us; error 45 us; skew 500 ppm
I20260808 02:43:07.110802 28884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:07.113814 28884 webserver.cc:460] Webserver started at http://127.10.20.126:35993/ using document root <none> and password file <none>
I20260808 02:43:07.114645 28884 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:07.114882 28884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:07.115262 28884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:07.118485 28884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "dc01b7c8855a438e9f171a95b0e24593"
format_stamp: "Formatted at 2026-08-08 02:43:07 on dist-test-slave-8tdl"
server_key: "eede02b389c694f7f90a9e0b40e8a797"
server_key_iv: "eb9f33e37f5b9b07e552f6c050a3805e"
server_key_version: "encryptionkey@0"
I20260808 02:43:07.119508 28884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "dc01b7c8855a438e9f171a95b0e24593"
format_stamp: "Formatted at 2026-08-08 02:43:07 on dist-test-slave-8tdl"
server_key: "eede02b389c694f7f90a9e0b40e8a797"
server_key_iv: "eb9f33e37f5b9b07e552f6c050a3805e"
server_key_version: "encryptionkey@0"
I20260808 02:43:07.125468 28884 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:43:07.129526 28899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:07.131633 28884 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:07.131891 28884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "dc01b7c8855a438e9f171a95b0e24593"
format_stamp: "Formatted at 2026-08-08 02:43:07 on dist-test-slave-8tdl"
server_key: "eede02b389c694f7f90a9e0b40e8a797"
server_key_iv: "eb9f33e37f5b9b07e552f6c050a3805e"
server_key_version: "encryptionkey@0"
I20260808 02:43:07.132159 28884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:07.163606 28884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:07.164603 28884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:07.164956 28884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:07.187108 28884 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:42813
I20260808 02:43:07.187211 28953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:42813 every 8 connection(s)
I20260808 02:43:07.188711 28884 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:07.193241 28954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:07.194240 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28884
I20260808 02:43:07.194490 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:07.195055 10321 external_mini_cluster.cc:1428] Setting key c4f42899a3ecbeddd320b4216ac28dbd
I20260808 02:43:07.210124 28954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593: Bootstrap starting.
I20260808 02:43:07.213002 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:07.197339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57582 (local address 127.10.20.126:42813)
0808 02:43:07.198757 (+ 1418us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:07.198787 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:07.198849 (+ 62us) server_negotiation.cc:407] Connection header received
0808 02:43:07.201019 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:07.201056 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:07.201863 (+ 807us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:07.202478 (+ 615us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:07.203137 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:07.205159 (+ 2022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:07.206975 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:07.208187 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:07.208405 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:07.209700 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:07.209712 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:07.209736 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:07.210596 (+ 860us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:07.210734 (+ 138us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:07.210766 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:07.210906 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:07.211142 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 02:43:07.211533 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":507,"threads_started":1}
I20260808 02:43:07.214577 28954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:07.215866 28954 log.cc:824] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:07.219310 28954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593: No bootstrap required, opened a new log
I20260808 02:43:07.227420 28954 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc01b7c8855a438e9f171a95b0e24593" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42813 } }
I20260808 02:43:07.227900 28954 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:07.228012 28954 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc01b7c8855a438e9f171a95b0e24593, State: Initialized, Role: FOLLOWER
I20260808 02:43:07.228762 28954 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc01b7c8855a438e9f171a95b0e24593" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42813 } }
I20260808 02:43:07.229071 28954 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:07.229243 28954 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:07.229471 28954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:07.232219 28954 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc01b7c8855a438e9f171a95b0e24593" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42813 } }
I20260808 02:43:07.232784 28954 leader_election.cc:302] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc01b7c8855a438e9f171a95b0e24593; no voters:
I20260808 02:43:07.233472 28954 leader_election.cc:288] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:07.233728 28959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:07.234745 28959 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [term 1 LEADER]: Becoming Leader. State: Replica: dc01b7c8855a438e9f171a95b0e24593, State: Running, Role: LEADER
I20260808 02:43:07.235666 28959 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc01b7c8855a438e9f171a95b0e24593" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42813 } }
I20260808 02:43:07.236171 28954 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:07.239583 28960 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc01b7c8855a438e9f171a95b0e24593" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc01b7c8855a438e9f171a95b0e24593" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42813 } } }
I20260808 02:43:07.239718 28962 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc01b7c8855a438e9f171a95b0e24593. Latest consensus state: current_term: 1 leader_uuid: "dc01b7c8855a438e9f171a95b0e24593" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc01b7c8855a438e9f171a95b0e24593" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42813 } } }
I20260808 02:43:07.240065 28960 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:07.240163 28962 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:07.247501 28967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:07.253933 28967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:07.265031 28967 catalog_manager.cc:1347] Generated new cluster ID: d57576f0a97148d092f7278d594b645b
I20260808 02:43:07.265206 28967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:07.278504 28967 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:07.280017 28967 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:07.299431 28967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593: Generated new TSK 0
I20260808 02:43:07.300593 28967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:07.315487 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42813
--builtin_ntp_servers=127.10.20.84:39709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:43:07.701339 28979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:07.701676 28979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:07.701777 28979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:07.710160 28979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:07.710295 28979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:07.710500 28979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:43:07.720666 28979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42813
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:07.722791 28979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:07.725659 28979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:07.742096 28984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:07.742089 28985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:07.742331 28987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:07.743088 28979 server_base.cc:1034] running on GCE node
I20260808 02:43:07.743748 28979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:07.744760 28979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:07.746026 28979 hybrid_clock.cc:648] HybridClock initialized: now 1786156987745958 us; error 47 us; skew 500 ppm
I20260808 02:43:07.746462 28979 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:07.749861 28979 webserver.cc:460] Webserver started at http://127.10.20.65:38365/ using document root <none> and password file <none>
I20260808 02:43:07.750806 28979 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:07.750932 28979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:07.751322 28979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:07.754547 28979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "9a277c5605df4ef4b6676b738b8c890f"
format_stamp: "Formatted at 2026-08-08 02:43:07 on dist-test-slave-8tdl"
server_key: "fe5483743479bbc58822c9303ee7f16b"
server_key_iv: "7b8a27ffcaf2edfcf484b7afb296273d"
server_key_version: "encryptionkey@0"
I20260808 02:43:07.755656 28979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "9a277c5605df4ef4b6676b738b8c890f"
format_stamp: "Formatted at 2026-08-08 02:43:07 on dist-test-slave-8tdl"
server_key: "fe5483743479bbc58822c9303ee7f16b"
server_key_iv: "7b8a27ffcaf2edfcf484b7afb296273d"
server_key_version: "encryptionkey@0"
I20260808 02:43:07.761373 28979 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 02:43:07.765302 28995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:07.767081 28979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 02:43:07.767300 28979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "9a277c5605df4ef4b6676b738b8c890f"
format_stamp: "Formatted at 2026-08-08 02:43:07 on dist-test-slave-8tdl"
server_key: "fe5483743479bbc58822c9303ee7f16b"
server_key_iv: "7b8a27ffcaf2edfcf484b7afb296273d"
server_key_version: "encryptionkey@0"
I20260808 02:43:07.767570 28979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:07.789307 28979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:07.790373 28979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:07.790791 28979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:07.792181 28979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:07.794129 28979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:07.794286 28979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:07.794595 28979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:07.794756 28979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:07.836470 28979 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:38069
I20260808 02:43:07.836526 29115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:38069 every 8 connection(s)
I20260808 02:43:07.838203 28979 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:43:07.843585 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 28979
I20260808 02:43:07.843814 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:43:07.844501 10321 external_mini_cluster.cc:1428] Setting key d47ea95e1e5391efa208e31a14cddb41
I20260808 02:43:07.848222 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42813
--builtin_ntp_servers=127.10.20.84:39709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:43:07.855628 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:07.841361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:35549 (local address 127.10.20.126:42813)
0808 02:43:07.841932 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:07.841937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:07.843394 (+ 1457us) server_negotiation.cc:407] Connection header received
0808 02:43:07.846100 (+ 2706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:07.846105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:07.846186 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:07.846284 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:07.847976 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:07.848834 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:07.851919 (+ 3085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:07.852428 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:07.852588 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:07.854564 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:07.854570 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:07.854574 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:07.854597 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:07.854644 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:07.854657 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:07.854788 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:07.855199 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 02:43:07.855312 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":275,"threads_started":1}
I20260808 02:43:07.857264 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:07.842017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42813 (local address 127.10.20.65:35549)
0808 02:43:07.843171 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:07.843231 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:07.845736 (+ 2505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:07.846614 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:07.846625 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:07.846805 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:07.847738 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:07.847770 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:07.849021 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:07.849031 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:07.851718 (+ 2687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:07.851742 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:07.852745 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:07.852756 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:07.853135 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:07.854072 (+ 937us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:07.854078 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:07.854144 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:07.854279 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:07.854837 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:07.854853 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:07.854865 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 02:43:07.855109 (+ 244us) client_negotiation.cc:240] Negotiation successful
0808 02:43:07.855644 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":333,"threads_started":1}
I20260808 02:43:07.859242 29116 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42813
I20260808 02:43:07.859623 29116 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:07.860746 29116 heartbeater.cc:511] Master 127.10.20.126:42813 requested a full tablet report, sending...
I20260808 02:43:07.863469 28918 ts_manager.cc:194] Registered new tserver with Master: 9a277c5605df4ef4b6676b738b8c890f (127.10.20.65:38069)
I20260808 02:43:07.866011 28918 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.65:35549
W20260808 02:43:08.220640 29120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:08.220973 29120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:08.221079 29120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:08.228554 29120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:08.228675 29120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:08.228786 29120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:43:08.239387 29120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42813
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:08.240726 29120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:08.242540 29120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:08.256994 29126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:08.256870 29129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:08.256942 29127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:08.257755 29120 server_base.cc:1034] running on GCE node
I20260808 02:43:08.258410 29120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:08.259533 29120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:08.260748 29120 hybrid_clock.cc:648] HybridClock initialized: now 1786156988260683 us; error 61 us; skew 500 ppm
I20260808 02:43:08.261080 29120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:08.263549 29120 webserver.cc:460] Webserver started at http://127.10.20.66:34275/ using document root <none> and password file <none>
I20260808 02:43:08.264374 29120 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:08.264518 29120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:08.264846 29120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:08.267995 29120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "9e34da79ea55497dae1e94d0fc9f4a6f"
format_stamp: "Formatted at 2026-08-08 02:43:08 on dist-test-slave-8tdl"
server_key: "11edaba48296af097f93dceabe485d2d"
server_key_iv: "0772cc897fa20af7716e15c79a918186"
server_key_version: "encryptionkey@0"
I20260808 02:43:08.268852 29120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "9e34da79ea55497dae1e94d0fc9f4a6f"
format_stamp: "Formatted at 2026-08-08 02:43:08 on dist-test-slave-8tdl"
server_key: "11edaba48296af097f93dceabe485d2d"
server_key_iv: "0772cc897fa20af7716e15c79a918186"
server_key_version: "encryptionkey@0"
I20260808 02:43:08.274613 29120 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 02:43:08.278575 29135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:08.280154 29120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:43:08.280345 29120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "9e34da79ea55497dae1e94d0fc9f4a6f"
format_stamp: "Formatted at 2026-08-08 02:43:08 on dist-test-slave-8tdl"
server_key: "11edaba48296af097f93dceabe485d2d"
server_key_iv: "0772cc897fa20af7716e15c79a918186"
server_key_version: "encryptionkey@0"
I20260808 02:43:08.280587 29120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:08.318041 29120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:08.319089 29120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:08.319429 29120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:08.320535 29120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:08.322412 29120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:08.322546 29120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:08.322705 29120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:08.322796 29120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 02:43:08.360991 29120 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:34635
I20260808 02:43:08.361095 29256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:34635 every 8 connection(s)
I20260808 02:43:08.362396 29120 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:43:08.370074 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 29120
I20260808 02:43:08.370291 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:43:08.370947 10321 external_mini_cluster.cc:1428] Setting key 3bc7818ea8bc852355b9f6c094627707
I20260808 02:43:08.374552 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42813
--builtin_ntp_servers=127.10.20.84:39709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:43:08.377331 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.365269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:58427 (local address 127.10.20.126:42813)
0808 02:43:08.365722 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:08.365727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:08.367060 (+ 1333us) server_negotiation.cc:407] Connection header received
0808 02:43:08.368873 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:08.368878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:08.369009 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:08.369126 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:08.370797 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.371688 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.373624 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.374301 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.374445 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.376098 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:08.376108 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:08.376116 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:08.376145 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:08.376206 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:08.376227 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:08.376338 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:08.376734 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 02:43:08.376862 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":234,"threads_started":1}
I20260808 02:43:08.378372 29260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.365916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42813 (local address 127.10.20.66:58427)
0808 02:43:08.366896 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:08.366934 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:08.368590 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:08.369370 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:08.369379 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:08.369467 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:08.370477 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.370506 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.371896 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.371901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.373462 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.373475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.374550 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.374556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.374927 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.375706 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:08.375708 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:08.375755 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:08.375850 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:08.376448 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:08.376485 (+ 37us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:08.376493 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 02:43:08.376685 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 02:43:08.377051 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":272,"threads_started":1}
I20260808 02:43:08.380134 29257 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42813
I20260808 02:43:08.380502 29257 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:08.381317 29257 heartbeater.cc:511] Master 127.10.20.126:42813 requested a full tablet report, sending...
I20260808 02:43:08.383033 28918 ts_manager.cc:194] Registered new tserver with Master: 9e34da79ea55497dae1e94d0fc9f4a6f (127.10.20.66:34635)
I20260808 02:43:08.383883 28918 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.66:58427
W20260808 02:43:08.741272 29261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:08.741657 29261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:08.741837 29261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:08.750630 29261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:08.750880 29261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:08.751096 29261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:43:08.762171 29261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42813
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:08.763928 29261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:08.765980 29261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:08.782241 29266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:08.782385 29267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:08.782385 29269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:08.783468 29261 server_base.cc:1034] running on GCE node
I20260808 02:43:08.784324 29261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:08.785544 29261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:08.786866 29261 hybrid_clock.cc:648] HybridClock initialized: now 1786156988786801 us; error 39 us; skew 500 ppm
I20260808 02:43:08.787333 29261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:08.790195 29261 webserver.cc:460] Webserver started at http://127.10.20.67:43497/ using document root <none> and password file <none>
I20260808 02:43:08.791154 29261 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:08.791335 29261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:08.791731 29261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:08.795318 29261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "4b92c8f7eb2d47019810077af9e7e6b6"
format_stamp: "Formatted at 2026-08-08 02:43:08 on dist-test-slave-8tdl"
server_key: "5884c4d27937e587949f6cca4b05012f"
server_key_iv: "6fb3084748f37b3e225087824ec1c3ed"
server_key_version: "encryptionkey@0"
I20260808 02:43:08.796316 29261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "4b92c8f7eb2d47019810077af9e7e6b6"
format_stamp: "Formatted at 2026-08-08 02:43:08 on dist-test-slave-8tdl"
server_key: "5884c4d27937e587949f6cca4b05012f"
server_key_iv: "6fb3084748f37b3e225087824ec1c3ed"
server_key_version: "encryptionkey@0"
I20260808 02:43:08.802779 29261 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:43:08.807303 29276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:08.808869 29261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:43:08.809188 29261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "4b92c8f7eb2d47019810077af9e7e6b6"
format_stamp: "Formatted at 2026-08-08 02:43:08 on dist-test-slave-8tdl"
server_key: "5884c4d27937e587949f6cca4b05012f"
server_key_iv: "6fb3084748f37b3e225087824ec1c3ed"
server_key_version: "encryptionkey@0"
I20260808 02:43:08.809448 29261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:08.827365 29261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:08.828425 29261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:08.828776 29261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:08.829871 29261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:08.831717 29261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:08.831851 29261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:08.831993 29261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:08.832105 29261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:08.869980 29116 heartbeater.cc:503] Master 127.10.20.126:42813 was elected leader, sending a full tablet report...
I20260808 02:43:08.872443 29261 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:40341
I20260808 02:43:08.872460 29404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:40341 every 8 connection(s)
I20260808 02:43:08.873996 29261 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:43:08.883450 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 29261
I20260808 02:43:08.883682 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:43:08.884174 10321 external_mini_cluster.cc:1428] Setting key 72aeeef8531dcfadbeb546e0612f2b05
I20260808 02:43:08.891798 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.877300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:59869 (local address 127.10.20.126:42813)
0808 02:43:08.877522 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:08.877528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:08.879059 (+ 1531us) server_negotiation.cc:407] Connection header received
0808 02:43:08.881067 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:08.881075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:08.881179 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:08.881297 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:08.882498 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.883604 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.886256 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.886819 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.886992 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.889722 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:08.889729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:08.889732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:08.889754 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:08.889793 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:08.889808 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:08.889927 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:08.890851 (+ 924us) server_negotiation.cc:299] Negotiation successful
0808 02:43:08.891051 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:43:08.893633 29407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.877697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42813 (local address 127.10.20.67:59869)
0808 02:43:08.878864 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:08.878914 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:08.880740 (+ 1826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:08.881562 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:08.881572 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:08.881670 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:08.882296 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.882314 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.883865 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.883870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.886065 (+ 2195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.886086 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.887110 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.887119 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.887609 (+ 490us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.889136 (+ 1527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:08.889139 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:08.889196 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:08.889332 (+ 136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:08.889934 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:08.889951 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:08.889961 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:43:08.890846 (+ 885us) client_negotiation.cc:240] Negotiation successful
0808 02:43:08.891807 (+ 961us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":358,"threads_started":1}
I20260808 02:43:08.895875 29405 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42813
I20260808 02:43:08.896251 29405 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:08.897145 29405 heartbeater.cc:511] Master 127.10.20.126:42813 requested a full tablet report, sending...
I20260808 02:43:08.899789 28918 ts_manager.cc:194] Registered new tserver with Master: 4b92c8f7eb2d47019810077af9e7e6b6 (127.10.20.67:40341)
I20260808 02:43:08.901069 28918 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.67:59869
I20260808 02:43:08.902521 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:43:08.916047 29259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.908468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57590 (local address 127.10.20.126:42813)
0808 02:43:08.908831 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:08.908841 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:08.909351 (+ 510us) server_negotiation.cc:407] Connection header received
0808 02:43:08.909605 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:08.909610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:08.909692 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:08.909803 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:08.910353 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.911221 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.912773 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.913333 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.913488 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.915062 (+ 1574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:08.915068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:08.915071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:08.915108 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:08.915146 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:08.915160 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:08.915240 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:08.915544 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 02:43:08.915648 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:43:08.921516 28917 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:43:08.929468 28917 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:43:08.957795 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.944809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56890 (local address 127.10.20.66:34635)
0808 02:43:08.945406 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:08.945418 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:08.947951 (+ 2533us) server_negotiation.cc:407] Connection header received
0808 02:43:08.948475 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:08.948491 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:08.948861 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:08.949102 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:08.949822 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.951676 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.955077 (+ 3401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.956492 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.956669 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.956960 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:08.957249 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 02:43:08.957433 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":304,"threads_started":1}
I20260808 02:43:08.957775 29417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.944645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34635 (local address 127.0.0.1:56890)
0808 02:43:08.947699 (+ 3054us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:08.947752 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:08.948119 (+ 367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:08.949162 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:08.949171 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:08.949195 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:08.949620 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.949636 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.951859 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.951865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.954758 (+ 2893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.954776 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.956707 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.956713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.956962 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.957042 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 02:43:08.957195 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 02:43:08.957432 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2655,"thread_start_us":885,"threads_started":1}
I20260808 02:43:08.959467 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.947020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.10.20.67:40341)
0808 02:43:08.948090 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:08.948101 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:08.949410 (+ 1309us) server_negotiation.cc:407] Connection header received
0808 02:43:08.949504 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:08.949510 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:08.949746 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:08.949966 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:08.951722 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.952952 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.955852 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.957392 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.957547 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.957896 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:08.958849 (+ 953us) server_negotiation.cc:299] Negotiation successful
0808 02:43:08.959042 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":853,"thread_start_us":661,"threads_started":1}
I20260808 02:43:08.959918 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.947317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:40341 (local address 127.0.0.1:50566)
0808 02:43:08.949094 (+ 1777us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:08.949112 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:08.949234 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:08.950762 (+ 1528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:08.950767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:08.950792 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:08.951166 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.951177 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.953122 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.953127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.955623 (+ 2496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.955635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.958058 (+ 2423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.958064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.958228 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.958266 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:43:08.958352 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 02:43:08.958530 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1631,"mutex_wait_us":35,"thread_start_us":1007,"threads_started":1}
I20260808 02:43:08.962277 29186 tablet_service.cc:1467] Processing CreateTablet for tablet 556d8d0171284c169f5b59276be72587 (DEFAULT_TABLE table=test-table [id=f82aa6e208234daa9ac8abef392a5bac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:08.963295 29421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.945332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43598)
0808 02:43:08.948980 (+ 3648us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:08.948999 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:08.949174 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:08.950185 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:08.950189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:08.950212 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:08.950749 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.950763 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.952890 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.952897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.955831 (+ 2934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:08.955847 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.958535 (+ 2688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.958540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:08.958795 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.958833 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:43:08.958924 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 02:43:08.959056 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3356,"mutex_wait_us":92,"thread_start_us":459,"threads_started":1}
I20260808 02:43:08.963557 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:08.946068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43598 (local address 127.10.20.65:38069)
0808 02:43:08.947178 (+ 1110us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:08.947198 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:08.949610 (+ 2412us) server_negotiation.cc:407] Connection header received
0808 02:43:08.949738 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:08.949747 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:08.949983 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:08.950184 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:08.951051 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.952681 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.956059 (+ 3378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:08.957584 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:08.957721 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:08.958403 (+ 682us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:08.962901 (+ 4498us) server_negotiation.cc:299] Negotiation successful
0808 02:43:08.963156 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":547,"threads_started":1}
I20260808 02:43:08.963850 29186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 556d8d0171284c169f5b59276be72587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:08.963297 29333 tablet_service.cc:1467] Processing CreateTablet for tablet 556d8d0171284c169f5b59276be72587 (DEFAULT_TABLE table=test-table [id=f82aa6e208234daa9ac8abef392a5bac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:08.965754 29333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 556d8d0171284c169f5b59276be72587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:08.967013 29048 tablet_service.cc:1467] Processing CreateTablet for tablet 556d8d0171284c169f5b59276be72587 (DEFAULT_TABLE table=test-table [id=f82aa6e208234daa9ac8abef392a5bac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:08.968262 29048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 556d8d0171284c169f5b59276be72587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:08.981490 29423 tablet_bootstrap.cc:492] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Bootstrap starting.
I20260808 02:43:08.987398 29423 tablet_bootstrap.cc:654] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:08.987615 29425 tablet_bootstrap.cc:492] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Bootstrap starting.
I20260808 02:43:08.988082 29424 tablet_bootstrap.cc:492] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Bootstrap starting.
I20260808 02:43:08.991276 29423 log.cc:824] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:08.991732 29425 tablet_bootstrap.cc:654] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:08.992035 29424 tablet_bootstrap.cc:654] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:08.993079 29425 log.cc:824] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:08.993528 29424 log.cc:824] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:08.995704 29423 tablet_bootstrap.cc:492] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: No bootstrap required, opened a new log
I20260808 02:43:08.996112 29423 ts_tablet_manager.cc:1397] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20260808 02:43:08.996624 29424 tablet_bootstrap.cc:492] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: No bootstrap required, opened a new log
I20260808 02:43:08.996917 29425 tablet_bootstrap.cc:492] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: No bootstrap required, opened a new log
I20260808 02:43:08.996925 29424 ts_tablet_manager.cc:1397] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:43:08.997242 29425 ts_tablet_manager.cc:1397] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260808 02:43:09.005846 29424 raft_consensus.cc:348] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.006614 29424 raft_consensus.cc:374] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:09.006855 29424 raft_consensus.cc:729] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a277c5605df4ef4b6676b738b8c890f, State: Initialized, Role: FOLLOWER
I20260808 02:43:09.008595 29424 consensus_queue.cc:260] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.009845 29423 raft_consensus.cc:348] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.010500 29423 raft_consensus.cc:374] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:09.010615 29423 raft_consensus.cc:729] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e34da79ea55497dae1e94d0fc9f4a6f, State: Initialized, Role: FOLLOWER
I20260808 02:43:09.010427 29425 raft_consensus.cc:348] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.010974 29425 raft_consensus.cc:374] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:09.011081 29425 raft_consensus.cc:729] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b92c8f7eb2d47019810077af9e7e6b6, State: Initialized, Role: FOLLOWER
I20260808 02:43:09.011581 29424 ts_tablet_manager.cc:1428] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260808 02:43:09.011477 29423 consensus_queue.cc:260] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.011677 29425 consensus_queue.cc:260] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.013302 29257 heartbeater.cc:503] Master 127.10.20.126:42813 was elected leader, sending a full tablet report...
I20260808 02:43:09.019049 29405 heartbeater.cc:503] Master 127.10.20.126:42813 was elected leader, sending a full tablet report...
I20260808 02:43:09.019932 29425 ts_tablet_manager.cc:1428] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Time spent starting tablet: real 0.023s user 0.015s sys 0.009s
I20260808 02:43:09.020342 29423 ts_tablet_manager.cc:1428] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Time spent starting tablet: real 0.024s user 0.019s sys 0.000s
W20260808 02:43:09.091324 29117 tablet.cc:2369] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:43:09.114928 29258 tablet.cc:2369] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:43:09.126159 29406 tablet.cc:2369] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:09.276973 29429 raft_consensus.cc:482] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:43:09.277367 29429 raft_consensus.cc:504] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.279371 29429 leader_election.cc:288] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e34da79ea55497dae1e94d0fc9f4a6f (127.10.20.66:34635), 4b92c8f7eb2d47019810077af9e7e6b6 (127.10.20.67:40341)
I20260808 02:43:09.287389 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.279827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:39713 (local address 127.10.20.66:34635)
0808 02:43:09.280132 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:09.280142 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:09.280554 (+ 412us) server_negotiation.cc:407] Connection header received
0808 02:43:09.280848 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:09.280856 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:09.280970 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:09.281075 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:09.281845 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.282939 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.285196 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.286280 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.286408 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.286463 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:09.286920 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 02:43:09.287030 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 02:43:09.287410 29432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.279639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:34635 (local address 127.10.20.65:39713)
0808 02:43:09.280431 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.280454 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:09.280683 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:09.281190 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:09.281195 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:09.281231 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:09.281647 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:09.281660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.283102 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.283108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:09.284966 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:09.284982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.286497 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.286505 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:09.286729 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.286767 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:43:09.286871 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:43:09.287029 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":406,"threads_started":1}
I20260808 02:43:09.288147 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.280813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:48225 (local address 127.10.20.67:40341)
0808 02:43:09.281158 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:09.281163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:09.281415 (+ 252us) server_negotiation.cc:407] Connection header received
0808 02:43:09.281625 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:09.281632 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:09.281714 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:09.281807 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:09.282556 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.283636 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.285915 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.287038 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.287197 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.287260 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:09.287696 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 02:43:09.287905 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198}
I20260808 02:43:09.288745 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.280453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:40341 (local address 127.10.20.65:48225)
0808 02:43:09.281304 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.281319 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:09.281479 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:09.281845 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:09.281850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:09.281876 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:09.282357 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:09.282369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.283810 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.283814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:09.285624 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:09.285639 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.287248 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.287255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:09.287485 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.287522 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:43:09.288352 (+ 830us) client_negotiation.cc:240] Negotiation successful
0808 02:43:09.288481 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"spinlock_wait_cycles":28416,"thread_start_us":471,"threads_started":1}
I20260808 02:43:09.288576 29208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "556d8d0171284c169f5b59276be72587" candidate_uuid: "9a277c5605df4ef4b6676b738b8c890f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" is_pre_election: true
I20260808 02:43:09.289237 29208 raft_consensus.cc:2454] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a277c5605df4ef4b6676b738b8c890f in term 0.
I20260808 02:43:09.289841 29355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "556d8d0171284c169f5b59276be72587" candidate_uuid: "9a277c5605df4ef4b6676b738b8c890f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" is_pre_election: true
I20260808 02:43:09.290000 28996 leader_election.cc:302] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a277c5605df4ef4b6676b738b8c890f, 9e34da79ea55497dae1e94d0fc9f4a6f; no voters:
I20260808 02:43:09.290351 29355 raft_consensus.cc:2454] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a277c5605df4ef4b6676b738b8c890f in term 0.
I20260808 02:43:09.290489 29429 raft_consensus.cc:2781] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:43:09.290669 29429 raft_consensus.cc:482] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:43:09.290831 29429 raft_consensus.cc:3037] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:09.293185 29429 raft_consensus.cc:504] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.293825 29429 leader_election.cc:288] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [CANDIDATE]: Term 1 election: Requested vote from peers 9e34da79ea55497dae1e94d0fc9f4a6f (127.10.20.66:34635), 4b92c8f7eb2d47019810077af9e7e6b6 (127.10.20.67:40341)
I20260808 02:43:09.294535 29208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "556d8d0171284c169f5b59276be72587" candidate_uuid: "9a277c5605df4ef4b6676b738b8c890f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f"
I20260808 02:43:09.294636 29355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "556d8d0171284c169f5b59276be72587" candidate_uuid: "9a277c5605df4ef4b6676b738b8c890f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b92c8f7eb2d47019810077af9e7e6b6"
I20260808 02:43:09.294807 29208 raft_consensus.cc:3037] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:09.294945 29355 raft_consensus.cc:3037] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:09.297189 29208 raft_consensus.cc:2454] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a277c5605df4ef4b6676b738b8c890f in term 1.
I20260808 02:43:09.297314 29355 raft_consensus.cc:2454] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a277c5605df4ef4b6676b738b8c890f in term 1.
I20260808 02:43:09.297703 28996 leader_election.cc:302] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a277c5605df4ef4b6676b738b8c890f, 9e34da79ea55497dae1e94d0fc9f4a6f; no voters:
I20260808 02:43:09.298094 29429 raft_consensus.cc:2781] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:09.298601 29429 raft_consensus.cc:686] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 1 LEADER]: Becoming Leader. State: Replica: 9a277c5605df4ef4b6676b738b8c890f, State: Running, Role: LEADER
I20260808 02:43:09.299110 29429 consensus_queue.cc:237] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } }
I20260808 02:43:09.304091 28918 catalog_manager.cc:5495] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a277c5605df4ef4b6676b738b8c890f (127.10.20.65). New cstate: current_term: 1 leader_uuid: "9a277c5605df4ef4b6676b738b8c890f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a277c5605df4ef4b6676b738b8c890f" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 38069 } health_report { overall_health: HEALTHY } } }
I20260808 02:43:09.335698 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.330151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43610 (local address 127.10.20.65:38069)
0808 02:43:09.330346 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:09.330350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:09.330368 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:43:09.330497 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:09.330500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:09.330589 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:09.330783 (+ 194us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:43:09.331099 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.331800 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.333237 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.333686 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.333784 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.334399 (+ 615us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:43:09.335047 (+ 648us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:43:09.335160 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:09.335290 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 02:43:09.335361 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:43:09.345077 29208 raft_consensus.cc:1261] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 1 FOLLOWER]: Refusing update from remote peer 9a277c5605df4ef4b6676b738b8c890f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:09.345116 29355 raft_consensus.cc:1261] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 1 FOLLOWER]: Refusing update from remote peer 9a277c5605df4ef4b6676b738b8c890f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:09.346231 29436 consensus_queue.cc:1035] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e34da79ea55497dae1e94d0fc9f4a6f" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:09.346690 29429 consensus_queue.cc:1035] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b92c8f7eb2d47019810077af9e7e6b6" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:09.359694 29439 mvcc.cc:205] Tried to move back new op lower bound from 7316099028345851904 to 7316099028172869632. Current Snapshot: MvccSnapshot[applied={T|T < 7316099028345851904}]
I20260808 02:43:09.382640 28916 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:09.383049 28916 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:09.388243 28916 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dc01b7c8855a438e9f171a95b0e24593: Sending DeleteTablet for 3 replicas of tablet 556d8d0171284c169f5b59276be72587
I20260808 02:43:09.389600 29048 tablet_service.cc:1514] Processing DeleteTablet for tablet 556d8d0171284c169f5b59276be72587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:09 UTC) from {username='slave'} at 127.0.0.1:43598
I20260808 02:43:09.390724 29333 tablet_service.cc:1514] Processing DeleteTablet for tablet 556d8d0171284c169f5b59276be72587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:09 UTC) from {username='slave'} at 127.0.0.1:50566
I20260808 02:43:09.390887 29047 tablet_service.cc:1514] Processing DeleteTablet for tablet 556d8d0171284c169f5b59276be72587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:09 UTC) from {username='slave'} at 127.0.0.1:43598
I20260808 02:43:09.392838 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28979
I20260808 02:43:09.400082 29186 tablet_service.cc:1514] Processing DeleteTablet for tablet 556d8d0171284c169f5b59276be72587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:09 UTC) from {username='slave'} at 127.0.0.1:56890
I20260808 02:43:09.401376 29453 tablet_replica.cc:330] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: stopping tablet replica
I20260808 02:43:09.402187 29453 raft_consensus.cc:2229] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:09.403054 29453 raft_consensus.cc:2258] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:09.405462 29451 tablet_replica.cc:330] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: stopping tablet replica
I20260808 02:43:09.405879 29453 ts_tablet_manager.cc:1905] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:09.405911 29451 raft_consensus.cc:2229] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:09.406643 29451 raft_consensus.cc:2258] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:09.408902 29450 tablet_replica.cc:330] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: stopping tablet replica
I20260808 02:43:09.409358 29450 raft_consensus.cc:2229] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:43:09.409941 29450 raft_consensus.cc:2258] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:09.412604 29450 ts_tablet_manager.cc:1905] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:09.414201 29453 ts_tablet_manager.cc:1918] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:09.414433 29453 log.cc:1196] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/556d8d0171284c169f5b59276be72587
I20260808 02:43:09.415067 29453 ts_tablet_manager.cc:1939] T 556d8d0171284c169f5b59276be72587 P 9e34da79ea55497dae1e94d0fc9f4a6f: Deleting consensus metadata
I20260808 02:43:09.416062 29451 ts_tablet_manager.cc:1905] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:09.417399 28900 catalog_manager.cc:4841] TS 9e34da79ea55497dae1e94d0fc9f4a6f (127.10.20.66:34635): tablet 556d8d0171284c169f5b59276be72587 (table test-table [id=f82aa6e208234daa9ac8abef392a5bac]) successfully deleted
I20260808 02:43:09.420114 29450 ts_tablet_manager.cc:1918] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:09.420266 29450 log.cc:1196] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/556d8d0171284c169f5b59276be72587
I20260808 02:43:09.420739 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.394501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43624 (local address 127.10.20.65:38069)
0808 02:43:09.394697 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:09.394704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:09.410875 (+ 16171us) server_negotiation.cc:407] Connection header received
0808 02:43:09.411126 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:09.411131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:09.411237 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:09.411340 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:09.412030 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.413243 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.416017 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.416699 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.416825 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.418657 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:09.418699 (+ 42us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:09.418718 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:09.419601 (+ 883us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:09.419677 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:09.419705 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:09.419807 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:09.420090 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 02:43:09.420236 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 02:43:09.420991 29450 ts_tablet_manager.cc:1939] T 556d8d0171284c169f5b59276be72587 P 9a277c5605df4ef4b6676b738b8c890f: Deleting consensus metadata
I20260808 02:43:09.421814 29111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:09.429538 29451 ts_tablet_manager.cc:1918] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:09.429757 29451 log.cc:1196] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/556d8d0171284c169f5b59276be72587
I20260808 02:43:09.430228 29451 ts_tablet_manager.cc:1939] T 556d8d0171284c169f5b59276be72587 P 4b92c8f7eb2d47019810077af9e7e6b6: Deleting consensus metadata
I20260808 02:43:09.432044 28900 catalog_manager.cc:4841] TS 4b92c8f7eb2d47019810077af9e7e6b6 (127.10.20.67:40341): tablet 556d8d0171284c169f5b59276be72587 (table test-table [id=f82aa6e208234daa9ac8abef392a5bac]) successfully deleted
I20260808 02:43:09.523170 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28979
I20260808 02:43:09.523326 28901 catalog_manager.cc:4841] TS 9a277c5605df4ef4b6676b738b8c890f (127.10.20.65:38069): tablet 556d8d0171284c169f5b59276be72587 (table test-table [id=f82aa6e208234daa9ac8abef392a5bac]) successfully deleted
I20260808 02:43:09.546051 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 29120
W20260808 02:43:09.546165 28901 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:38069 (error 108)
I20260808 02:43:09.548331 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.547496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43630)
0808 02:43:09.547966 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.548101 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":228,"threads_started":1}
W20260808 02:43:09.548673 28901 catalog_manager.cc:4584] TS 9a277c5605df4ef4b6676b738b8c890f (127.10.20.65:38069): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 556d8d0171284c169f5b59276be72587: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
I20260808 02:43:09.555222 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.547090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56898 (local address 127.10.20.66:34635)
0808 02:43:09.547296 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:09.547304 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:09.547327 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:43:09.547565 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:09.547570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:09.547721 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:09.547840 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:09.548308 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.549160 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.551636 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.552212 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.552372 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.553642 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:09.553652 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:09.553668 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:09.554358 (+ 690us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:09.554418 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:09.554440 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:09.554586 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:09.554741 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 02:43:09.554877 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 02:43:09.555941 29251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:09.603029 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.602367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43638)
0808 02:43:09.602657 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.602833 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 02:43:09.604436 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.603865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43640)
0808 02:43:09.604138 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.604243 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 02:43:09.651072 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 29120
I20260808 02:43:09.665344 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.664786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43646)
0808 02:43:09.665073 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.665166 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 02:43:09.666476 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.666105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43658)
0808 02:43:09.666254 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.666333 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 02:43:09.672676 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 29261
I20260808 02:43:09.680253 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.673570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50576 (local address 127.10.20.67:40341)
0808 02:43:09.673755 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:09.673760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:09.673780 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:43:09.673923 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:09.673927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:09.674021 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:09.674129 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:09.674629 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.675486 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.676825 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:09.677236 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:09.677353 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:09.678605 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:09.678614 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:09.678629 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:09.679430 (+ 801us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:09.679483 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:09.679506 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:09.679610 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:09.679853 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 02:43:09.679964 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:43:09.681295 29400 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:09.747278 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.746812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43672)
0808 02:43:09.747009 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.747120 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 02:43:09.748415 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:09.747988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:38069 (local address 127.0.0.1:43680)
0808 02:43:09.748197 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:09.748264 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:38069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 02:43:09.779564 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 29261
I20260808 02:43:09.798928 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 28884
I20260808 02:43:09.800153 28949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:09.915777 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 28884
2026-08-08T02:43:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3326 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:10 dist-test-slave-8tdl krb5kdc[29462](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:10 dist-test-slave-8tdl krb5kdc[29462](info): set up 2 sockets
Aug 08 02:43:10 dist-test-slave-8tdl krb5kdc[29462](info): commencing operation
krb5kdc: starting...
W20260808 02:43:11.130935 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:11 dist-test-slave-8tdl krb5kdc[29462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:43:11.522189 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42185
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:42185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:11.888597 29476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:11.888952 29476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:11.889052 29476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:11.896590 29476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:11.896729 29476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:11.896780 29476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:11.896832 29476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:11.896886 29476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:11.907642 29476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:42185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:42185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:11.909057 29476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:11.910386 29476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:11.923286 29482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:11.923409 29485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:11.923589 29483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:11.924487 29476 server_base.cc:1034] running on GCE node
I20260808 02:43:11.925354 29476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:11.927003 29476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:11.928236 29476 hybrid_clock.cc:648] HybridClock initialized: now 1786156991928163 us; error 63 us; skew 500 ppm
I20260808 02:43:11.928650 29476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:11 dist-test-slave-8tdl krb5kdc[29462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156991, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:11.936726 29476 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:43:11.938647 29476 webserver.cc:460] Webserver started at http://127.10.20.126:41031/ using document root <none> and password file <none>
I20260808 02:43:11.939445 29476 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:11.939567 29476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:11.939837 29476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:11.943192 29476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "ee6d2e31be1a4f60ab28b852edc29784"
format_stamp: "Formatted at 2026-08-08 02:43:11 on dist-test-slave-8tdl"
server_key: "e6fd109f6183c0537105813bc2aec962"
server_key_iv: "73bdbd0d89550b18d97b67a38d09701e"
server_key_version: "encryptionkey@0"
I20260808 02:43:11.943972 29476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "ee6d2e31be1a4f60ab28b852edc29784"
format_stamp: "Formatted at 2026-08-08 02:43:11 on dist-test-slave-8tdl"
server_key: "e6fd109f6183c0537105813bc2aec962"
server_key_iv: "73bdbd0d89550b18d97b67a38d09701e"
server_key_version: "encryptionkey@0"
I20260808 02:43:11.950089 29476 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:43:11.954166 29493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:11.955879 29476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 02:43:11.956135 29476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "ee6d2e31be1a4f60ab28b852edc29784"
format_stamp: "Formatted at 2026-08-08 02:43:11 on dist-test-slave-8tdl"
server_key: "e6fd109f6183c0537105813bc2aec962"
server_key_iv: "73bdbd0d89550b18d97b67a38d09701e"
server_key_version: "encryptionkey@0"
I20260808 02:43:11.956387 29476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:11.979581 29476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:11.984584 29476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:11.984915 29476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:12.005622 29476 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:42185
I20260808 02:43:12.005682 29548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:42185 every 8 connection(s)
I20260808 02:43:12.007298 29476 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:12.009931 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 29476
I20260808 02:43:12.010154 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:12.010640 10321 external_mini_cluster.cc:1428] Setting key ccd73ab54ba9ea795b2fab11e884e348
I20260808 02:43:12.012159 29549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:43:12 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:12.028805 29549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784: Bootstrap starting.
I20260808 02:43:12.033842 29549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:12.035476 29549 log.cc:824] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:12.039424 29549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784: No bootstrap required, opened a new log
I20260808 02:43:12.039709 29552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:12.012823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60750 (local address 127.10.20.126:42185)
0808 02:43:12.013744 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:12.013763 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:12.013822 (+ 59us) server_negotiation.cc:407] Connection header received
0808 02:43:12.016252 (+ 2430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:12.016286 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:12.016939 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:12.017472 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:12.019188 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:12.021548 (+ 2360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:12.023193 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:12.024396 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:12.024631 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:12.029394 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:12.029407 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:12.029430 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:12.029500 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:12.034237 (+ 4737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:12.035345 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:12.035354 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:12.035364 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:12.035642 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:12.036171 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:12.036180 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:12.036187 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:12.036854 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:12.037233 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:12.037668 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 02:43:12.038165 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":388,"threads_started":1}
I20260808 02:43:12.048965 29549 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6d2e31be1a4f60ab28b852edc29784" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42185 } }
I20260808 02:43:12.049593 29549 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:12.049753 29549 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6d2e31be1a4f60ab28b852edc29784, State: Initialized, Role: FOLLOWER
I20260808 02:43:12.050470 29549 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6d2e31be1a4f60ab28b852edc29784" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42185 } }
I20260808 02:43:12.050794 29549 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:12.051004 29549 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:12.051209 29549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:12.053795 29549 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6d2e31be1a4f60ab28b852edc29784" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42185 } }
I20260808 02:43:12.054441 29549 leader_election.cc:302] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6d2e31be1a4f60ab28b852edc29784; no voters:
I20260808 02:43:12.055284 29549 leader_election.cc:288] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:12.055496 29554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:12.056738 29554 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [term 1 LEADER]: Becoming Leader. State: Replica: ee6d2e31be1a4f60ab28b852edc29784, State: Running, Role: LEADER
I20260808 02:43:12.057433 29554 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6d2e31be1a4f60ab28b852edc29784" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42185 } }
I20260808 02:43:12.057890 29549 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:12.061239 29555 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee6d2e31be1a4f60ab28b852edc29784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6d2e31be1a4f60ab28b852edc29784" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42185 } } }
I20260808 02:43:12.061172 29556 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6d2e31be1a4f60ab28b852edc29784. Latest consensus state: current_term: 1 leader_uuid: "ee6d2e31be1a4f60ab28b852edc29784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6d2e31be1a4f60ab28b852edc29784" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 42185 } } }
I20260808 02:43:12.061714 29555 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:12.061738 29556 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:12.064509 29561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:12.071293 29561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:12.080919 29561 catalog_manager.cc:1347] Generated new cluster ID: 3b5506a6b8ab4952a231a9859d252a04
I20260808 02:43:12.081059 29561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:12.095420 29561 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:12.097785 29561 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:12.110059 29561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784: Generated new TSK 0
I20260808 02:43:12.111081 29561 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:43:12.206192 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42185
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:12.572158 29577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:12.572566 29577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:12.572753 29577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:12.580336 29577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:12.580464 29577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:12.580639 29577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:43:12.590921 29577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:12.592314 29577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:12.593660 29577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:12.607393 29582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:12.607350 29587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:12.607316 29583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:12.608229 29577 server_base.cc:1034] running on GCE node
I20260808 02:43:12.608858 29577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:12.609891 29577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:12.611140 29577 hybrid_clock.cc:648] HybridClock initialized: now 1786156992611106 us; error 51 us; skew 500 ppm
I20260808 02:43:12.611510 29577 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:12 dist-test-slave-8tdl krb5kdc[29462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156992, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:12.615116 29577 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:43:12.616812 29577 webserver.cc:460] Webserver started at http://127.10.20.65:44635/ using document root <none> and password file <none>
I20260808 02:43:12.617605 29577 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:12.617755 29577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:12.618146 29577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:12.621584 29577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "10d0cba23ae14423b74bd850b77e3c82"
format_stamp: "Formatted at 2026-08-08 02:43:12 on dist-test-slave-8tdl"
server_key: "a21f08c176ef23e9e9e1f9a4d91bbfae"
server_key_iv: "4a368b80a2fe0b73738a75ac75cd24df"
server_key_version: "encryptionkey@0"
I20260808 02:43:12.622495 29577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "10d0cba23ae14423b74bd850b77e3c82"
format_stamp: "Formatted at 2026-08-08 02:43:12 on dist-test-slave-8tdl"
server_key: "a21f08c176ef23e9e9e1f9a4d91bbfae"
server_key_iv: "4a368b80a2fe0b73738a75ac75cd24df"
server_key_version: "encryptionkey@0"
I20260808 02:43:12.628866 29577 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 02:43:12.633450 29595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:12.635519 29577 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:12.635871 29577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "10d0cba23ae14423b74bd850b77e3c82"
format_stamp: "Formatted at 2026-08-08 02:43:12 on dist-test-slave-8tdl"
server_key: "a21f08c176ef23e9e9e1f9a4d91bbfae"
server_key_iv: "4a368b80a2fe0b73738a75ac75cd24df"
server_key_version: "encryptionkey@0"
I20260808 02:43:12.636138 29577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:12.651254 29577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:12.656335 29577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:12.656626 29577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:12.657701 29577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:12.659350 29577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:12.659432 29577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:12.659529 29577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:12.659578 29577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:12.696929 29577 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:40147
I20260808 02:43:12.696969 29713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:40147 every 8 connection(s)
I20260808 02:43:12.698312 29577 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:43:12.704998 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 29577
I20260808 02:43:12.705272 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:43:12.705817 10321 external_mini_cluster.cc:1428] Setting key 883522eb5cc509c3c3cbd38ef3319584
Aug 08 02:43:12 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156992, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:12.721895 29716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:12.701400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:49479 (local address 127.10.20.126:42185)
0808 02:43:12.701926 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:12.701932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:12.703136 (+ 1204us) server_negotiation.cc:407] Connection header received
0808 02:43:12.705368 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:12.705376 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:12.705485 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:12.705629 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:12.707932 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:12.708736 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:12.710570 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:12.711125 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:12.711299 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:12.715376 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:12.715382 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:12.715385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:12.715425 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:12.718305 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:12.719336 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:12.719340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:12.719343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:12.719478 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:12.719959 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:12.719966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:12.719973 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:12.720252 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:12.720423 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:12.721241 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 02:43:12.721504 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":249,"threads_started":1}
I20260808 02:43:12.722990 29717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:12.702000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42185 (local address 127.10.20.65:49479)
0808 02:43:12.702939 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:12.702993 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:12.704956 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:12.705940 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:12.705956 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:12.706801 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:12.707711 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:12.707742 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:12.708937 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:12.708943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:12.710393 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:12.710408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:12.711417 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:12.711427 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:12.711707 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:12.712511 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:12.712537 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:12.715099 (+ 2562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:12.718505 (+ 3406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:12.718515 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:12.718548 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:12.719185 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:12.719603 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:12.719608 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:12.719612 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:12.719824 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:12.720422 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:12.720431 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:12.720829 (+ 398us) client_negotiation.cc:769] Sending connection context
0808 02:43:12.721119 (+ 290us) client_negotiation.cc:240] Negotiation successful
0808 02:43:12.721709 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":372,"threads_started":1}
I20260808 02:43:12.724825 29714 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42185
I20260808 02:43:12.725193 29714 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:12.726156 29714 heartbeater.cc:511] Master 127.10.20.126:42185 requested a full tablet report, sending...
I20260808 02:43:12.729009 29511 ts_manager.cc:194] Registered new tserver with Master: 10d0cba23ae14423b74bd850b77e3c82 (127.10.20.65:40147)
I20260808 02:43:12.731302 29511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:49479
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:43:12.790975 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42185
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:13.150434 29720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:13.150820 29720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:13.150943 29720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:13.158715 29720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:13.158866 29720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:13.158998 29720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:43:13.173888 29720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:13.175710 29720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:13.177142 29720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:13.192209 29725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:13.192209 29728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:13.192209 29726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:13.193269 29720 server_base.cc:1034] running on GCE node
I20260808 02:43:13.194018 29720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:13.195278 29720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:13.196560 29720 hybrid_clock.cc:648] HybridClock initialized: now 1786156993196518 us; error 105 us; skew 500 ppm
I20260808 02:43:13.196949 29720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:13 dist-test-slave-8tdl krb5kdc[29462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156993, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:13.200698 29720 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:43:13.202658 29720 webserver.cc:460] Webserver started at http://127.10.20.66:44593/ using document root <none> and password file <none>
I20260808 02:43:13.203765 29720 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:13.203958 29720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:13.204319 29720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:13.207777 29720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "30900f1928b847358e14430744e3fae3"
format_stamp: "Formatted at 2026-08-08 02:43:13 on dist-test-slave-8tdl"
server_key: "b77301ab5fe9aea814dd68d53de38b5f"
server_key_iv: "163a98e320d6d1fbf1b4496ec021c5cd"
server_key_version: "encryptionkey@0"
I20260808 02:43:13.208698 29720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "30900f1928b847358e14430744e3fae3"
format_stamp: "Formatted at 2026-08-08 02:43:13 on dist-test-slave-8tdl"
server_key: "b77301ab5fe9aea814dd68d53de38b5f"
server_key_iv: "163a98e320d6d1fbf1b4496ec021c5cd"
server_key_version: "encryptionkey@0"
I20260808 02:43:13.214767 29720 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 02:43:13.219110 29735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:13.220674 29720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 02:43:13.220906 29720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "30900f1928b847358e14430744e3fae3"
format_stamp: "Formatted at 2026-08-08 02:43:13 on dist-test-slave-8tdl"
server_key: "b77301ab5fe9aea814dd68d53de38b5f"
server_key_iv: "163a98e320d6d1fbf1b4496ec021c5cd"
server_key_version: "encryptionkey@0"
I20260808 02:43:13.221153 29720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:13.266002 29720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:13.270499 29720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:13.270865 29720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:13.271929 29720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:13.273445 29720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:13.273557 29720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:13.273716 29720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:13.273793 29720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:13.311986 29720 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:39907
I20260808 02:43:13.312088 29857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:39907 every 8 connection(s)
I20260808 02:43:13.313489 29720 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:43:13.319093 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 29720
I20260808 02:43:13.319326 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:43:13.319985 10321 external_mini_cluster.cc:1428] Setting key 9d592b8175c384823ef742ff17c9a175
Aug 08 02:43:13 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156993, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:13.340443 29860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.316617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:51581 (local address 127.10.20.126:42185)
0808 02:43:13.317370 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:13.317380 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:13.318007 (+ 627us) server_negotiation.cc:407] Connection header received
0808 02:43:13.320959 (+ 2952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:13.320966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:13.321077 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:13.321217 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:13.324369 (+ 3152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.325234 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.328213 (+ 2979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.328713 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.328832 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:13.333934 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:13.333939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:13.333942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:13.333985 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:13.336938 (+ 2953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:13.337838 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:13.337842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:13.337844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:13.337974 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:13.338500 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:13.338504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:13.338507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:13.338869 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:13.339034 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:13.339807 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 02:43:13.340056 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":438,"threads_started":1}
I20260808 02:43:13.341687 29861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.317017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42185 (local address 127.10.20.66:51581)
0808 02:43:13.317810 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:13.317860 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:13.320597 (+ 2737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:13.322158 (+ 1561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:13.322167 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:13.323136 (+ 969us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:13.324129 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:13.324163 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.325406 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.325415 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:13.327995 (+ 2580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:13.328018 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.329005 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.329017 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:13.329400 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:13.330361 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:13.330401 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:13.333585 (+ 3184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:13.337136 (+ 3551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:13.337146 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:13.337166 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:13.337670 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:13.338098 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:13.338103 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:13.338107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:13.338357 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:13.339006 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:13.339015 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:13.339409 (+ 394us) client_negotiation.cc:769] Sending connection context
0808 02:43:13.339690 (+ 281us) client_negotiation.cc:240] Negotiation successful
0808 02:43:13.340377 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":342,"threads_started":1}
I20260808 02:43:13.343541 29858 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42185
I20260808 02:43:13.343921 29858 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:13.345098 29858 heartbeater.cc:511] Master 127.10.20.126:42185 requested a full tablet report, sending...
I20260808 02:43:13.347043 29511 ts_manager.cc:194] Registered new tserver with Master: 30900f1928b847358e14430744e3fae3 (127.10.20.66:39907)
I20260808 02:43:13.348522 29511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:51581
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:43:13.406826 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42185
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:43:13.735744 29714 heartbeater.cc:503] Master 127.10.20.126:42185 was elected leader, sending a full tablet report...
W20260808 02:43:13.777886 29865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:13.778268 29865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:13.778443 29865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:13.786547 29865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:13.786773 29865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:13.786988 29865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:43:13.797515 29865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:42185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:13.799512 29865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:13.801012 29865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:13.816329 29870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:13.816419 29871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:13.816419 29873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:13.817224 29865 server_base.cc:1034] running on GCE node
I20260808 02:43:13.817898 29865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:13.819029 29865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:13.820251 29865 hybrid_clock.cc:648] HybridClock initialized: now 1786156993820170 us; error 59 us; skew 500 ppm
I20260808 02:43:13.820693 29865 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:13 dist-test-slave-8tdl krb5kdc[29462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156993, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:13.824941 29865 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:43:13.826968 29865 webserver.cc:460] Webserver started at http://127.10.20.67:43407/ using document root <none> and password file <none>
I20260808 02:43:13.827855 29865 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:13.828042 29865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:13.828428 29865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:13.832042 29865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "75a4e40754864c719e273a4bf598e03d"
format_stamp: "Formatted at 2026-08-08 02:43:13 on dist-test-slave-8tdl"
server_key: "9004bb8718574c26ae4d680380bc9585"
server_key_iv: "0668e0d0d22c15f217033adfc930d2ec"
server_key_version: "encryptionkey@0"
I20260808 02:43:13.833101 29865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "75a4e40754864c719e273a4bf598e03d"
format_stamp: "Formatted at 2026-08-08 02:43:13 on dist-test-slave-8tdl"
server_key: "9004bb8718574c26ae4d680380bc9585"
server_key_iv: "0668e0d0d22c15f217033adfc930d2ec"
server_key_version: "encryptionkey@0"
I20260808 02:43:13.839965 29865 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 02:43:13.844429 29880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:13.846112 29865 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:43:13.846338 29865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "75a4e40754864c719e273a4bf598e03d"
format_stamp: "Formatted at 2026-08-08 02:43:13 on dist-test-slave-8tdl"
server_key: "9004bb8718574c26ae4d680380bc9585"
server_key_iv: "0668e0d0d22c15f217033adfc930d2ec"
server_key_version: "encryptionkey@0"
I20260808 02:43:13.846623 29865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:13.861289 29865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:13.866410 29865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:13.866827 29865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:13.867975 29865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:13.869452 29865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:13.869570 29865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:13.869730 29865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:13.869810 29865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:13.906574 29865 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:39867
I20260808 02:43:13.906623 29999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:39867 every 8 connection(s)
I20260808 02:43:13.907991 29865 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:43:13.914973 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 29865
I20260808 02:43:13.915194 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:43:13.915776 10321 external_mini_cluster.cc:1428] Setting key ba2e91ad327d660c84674229aa96bfaf
Aug 08 02:43:13 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156993, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:13.931038 30002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.910783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:41191 (local address 127.10.20.126:42185)
0808 02:43:13.911307 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:13.911313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:13.912232 (+ 919us) server_negotiation.cc:407] Connection header received
0808 02:43:13.914231 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:13.914237 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:13.914357 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:13.914487 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:13.916505 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.917453 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.919730 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.920132 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.920232 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:13.924105 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:13.924110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:13.924114 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:13.924149 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:13.927343 (+ 3194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:13.928200 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:13.928205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:13.928207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:13.928336 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:13.928819 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:13.928823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:13.928825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:13.929154 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:13.929320 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:13.930309 (+ 989us) server_negotiation.cc:299] Negotiation successful
0808 02:43:13.930581 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":268,"threads_started":1}
I20260808 02:43:13.932168 30003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.911218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:42185 (local address 127.10.20.67:41191)
0808 02:43:13.912026 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:13.912072 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:13.913927 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:13.914766 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:13.914775 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:13.915494 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:13.916182 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:13.916227 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.917650 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.917655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:13.919587 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:13.919600 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.920398 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.920405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:13.920638 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:13.921393 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:13.921417 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:13.923850 (+ 2433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:13.927542 (+ 3692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:13.927550 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:13.927564 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:13.928052 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:13.928465 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:13.928469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:13.928472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:13.928675 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:13.929290 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:13.929297 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:13.929742 (+ 445us) client_negotiation.cc:769] Sending connection context
0808 02:43:13.930077 (+ 335us) client_negotiation.cc:240] Negotiation successful
0808 02:43:13.930639 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":320,"threads_started":1}
I20260808 02:43:13.933542 30000 heartbeater.cc:347] Connected to a master server at 127.10.20.126:42185
I20260808 02:43:13.933900 30000 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:13.934747 30000 heartbeater.cc:511] Master 127.10.20.126:42185 requested a full tablet report, sending...
I20260808 02:43:13.936511 29511 ts_manager.cc:194] Registered new tserver with Master: 75a4e40754864c719e273a4bf598e03d (127.10.20.67:39867)
I20260808 02:43:13.937474 29511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:41191
I20260808 02:43:13.945657 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:43:13.966895 30002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.950829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60766 (local address 127.10.20.126:42185)
0808 02:43:13.951072 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:13.951083 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:13.951577 (+ 494us) server_negotiation.cc:407] Connection header received
0808 02:43:13.951818 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:13.951824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:13.951918 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:13.952115 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:13.953715 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.954494 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.956115 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.956538 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.956688 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:13.960047 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:13.960054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:13.960059 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:13.960114 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:13.963549 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:13.964559 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:13.964563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:13.964566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:13.964702 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:13.965227 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:13.965230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:13.965232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:13.965578 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:13.965897 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:13.966340 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 02:43:13.966559 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:43:13.971558 29511 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60766:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:43:13.978861 29511 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:43:14.005759 30014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.993181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:39867 (local address 127.0.0.1:57502)
0808 02:43:13.995832 (+ 2651us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:13.995848 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:13.995953 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:13.996961 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:13.996969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:13.997000 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:13.997505 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:13.997522 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.999633 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:13.999638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.002093 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.002109 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.004560 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.004567 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.004835 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.004899 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 02:43:14.005062 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 02:43:14.005283 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2526,"mutex_wait_us":6,"thread_start_us":2487,"threads_started":1}
I20260808 02:43:14.011008 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.993407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57502 (local address 127.10.20.67:39867)
0808 02:43:13.995373 (+ 1966us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:13.995382 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:13.996091 (+ 709us) server_negotiation.cc:407] Connection header received
0808 02:43:13.996183 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:13.996189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:13.996433 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:13.996629 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:13.997720 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:13.999463 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.002317 (+ 2854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.003969 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.004126 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.004417 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.010373 (+ 5956us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.010597 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1777,"thread_start_us":1590,"threads_started":1}
I20260808 02:43:14.012421 30015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.993159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57628 (local address 127.10.20.65:40147)
0808 02:43:13.994967 (+ 1808us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:13.994980 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:13.995897 (+ 917us) server_negotiation.cc:407] Connection header received
0808 02:43:13.996172 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:13.996181 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:13.997886 (+ 1705us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:13.998084 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:13.999062 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.002065 (+ 3003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.006807 (+ 4742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.008400 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.008547 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.008794 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.011663 (+ 2869us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.011923 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1582,"thread_start_us":1410,"threads_started":1}
I20260808 02:43:14.013549 30013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.992785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:40147 (local address 127.0.0.1:57628)
0808 02:43:13.995595 (+ 2810us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:13.995652 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:13.995892 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:13.998355 (+ 2463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:13.998361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:13.998390 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:13.998819 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:13.998832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.002247 (+ 3415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.002252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.006544 (+ 4292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.006564 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.009893 (+ 3329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.009901 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.010108 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.010143 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:43:14.012678 (+ 2535us) client_negotiation.cc:240] Negotiation successful
0808 02:43:14.012922 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2505,"mutex_wait_us":1620,"thread_start_us":2405,"threads_started":1}
I20260808 02:43:14.016255 29931 tablet_service.cc:1467] Processing CreateTablet for tablet cc2471251d3a4514b329d382278d8e69 (DEFAULT_TABLE table=test-table [id=b7167dcdd9584d86a8bb77ac3d28fe8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:14.018088 29931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc2471251d3a4514b329d382278d8e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:14.018863 29645 tablet_service.cc:1467] Processing CreateTablet for tablet cc2471251d3a4514b329d382278d8e69 (DEFAULT_TABLE table=test-table [id=b7167dcdd9584d86a8bb77ac3d28fe8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:14.020974 29645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc2471251d3a4514b329d382278d8e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:14.035197 30019 tablet_bootstrap.cc:492] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Bootstrap starting.
I20260808 02:43:14.036296 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.996052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:39907 (local address 127.0.0.1:33720)
0808 02:43:14.010709 (+ 14657us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:14.010740 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:14.010935 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:14.028100 (+ 17165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:14.028106 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:14.028138 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:14.028598 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.028613 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.030791 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.030798 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.033043 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.033064 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.035365 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.035372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.035581 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.035619 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:43:14.035725 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 02:43:14.035894 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14421,"thread_start_us":15026,"threads_started":1}
I20260808 02:43:14.037205 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:13.996321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.10.20.66:39907)
0808 02:43:14.027551 (+ 31230us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.027558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.027588 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:43:14.027673 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.027679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.027871 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.028103 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:14.028889 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.030564 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.033271 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.034864 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.035008 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.035212 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.036669 (+ 1457us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.036875 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31053,"thread_start_us":30920,"threads_started":1}
I20260808 02:43:14.038908 30019 tablet_bootstrap.cc:654] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:14.040053 30020 tablet_bootstrap.cc:492] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Bootstrap starting.
I20260808 02:43:14.041045 30019 log.cc:824] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:14.041649 29785 tablet_service.cc:1467] Processing CreateTablet for tablet cc2471251d3a4514b329d382278d8e69 (DEFAULT_TABLE table=test-table [id=b7167dcdd9584d86a8bb77ac3d28fe8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:14.043220 29785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc2471251d3a4514b329d382278d8e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:14.044325 30020 tablet_bootstrap.cc:654] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:14.044945 30019 tablet_bootstrap.cc:492] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: No bootstrap required, opened a new log
I20260808 02:43:14.045245 30019 ts_tablet_manager.cc:1397] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260808 02:43:14.045717 30020 log.cc:824] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:14.049122 30020 tablet_bootstrap.cc:492] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: No bootstrap required, opened a new log
I20260808 02:43:14.049425 30020 ts_tablet_manager.cc:1397] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 02:43:14.056273 30023 tablet_bootstrap.cc:492] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Bootstrap starting.
I20260808 02:43:14.056744 30019 raft_consensus.cc:348] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.057464 30019 raft_consensus.cc:374] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:14.057607 30019 raft_consensus.cc:729] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a4e40754864c719e273a4bf598e03d, State: Initialized, Role: FOLLOWER
I20260808 02:43:14.058300 30019 consensus_queue.cc:260] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.059697 30000 heartbeater.cc:503] Master 127.10.20.126:42185 was elected leader, sending a full tablet report...
I20260808 02:43:14.060359 30019 ts_tablet_manager.cc:1428] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260808 02:43:14.060401 30023 tablet_bootstrap.cc:654] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:14.061918 30023 log.cc:824] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:14.062122 30020 raft_consensus.cc:348] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.062552 30020 raft_consensus.cc:374] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:14.062754 30020 raft_consensus.cc:729] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d0cba23ae14423b74bd850b77e3c82, State: Initialized, Role: FOLLOWER
I20260808 02:43:14.063489 30020 consensus_queue.cc:260] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.065548 30020 ts_tablet_manager.cc:1428] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260808 02:43:14.067294 30023 tablet_bootstrap.cc:492] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: No bootstrap required, opened a new log
I20260808 02:43:14.067713 30023 ts_tablet_manager.cc:1397] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260808 02:43:14.075635 30023 raft_consensus.cc:348] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.076135 30023 raft_consensus.cc:374] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:14.076253 30023 raft_consensus.cc:729] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30900f1928b847358e14430744e3fae3, State: Initialized, Role: FOLLOWER
I20260808 02:43:14.076875 30023 consensus_queue.cc:260] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.078078 29858 heartbeater.cc:503] Master 127.10.20.126:42185 was elected leader, sending a full tablet report...
I20260808 02:43:14.078889 30023 ts_tablet_manager.cc:1428] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260808 02:43:14.159338 30028 raft_consensus.cc:482] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260808 02:43:14.159786 30001 tablet.cc:2369] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:14.159905 30028 raft_consensus.cc:504] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.162014 30028 leader_election.cc:288] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d0cba23ae14423b74bd850b77e3c82 (127.10.20.65:40147), 75a4e40754864c719e273a4bf598e03d (127.10.20.67:39867)
I20260808 02:43:14.169654 30015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.162620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:55831 (local address 127.10.20.65:40147)
0808 02:43:14.162913 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.162923 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.163802 (+ 879us) server_negotiation.cc:407] Connection header received
0808 02:43:14.164086 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.164091 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.164156 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.164263 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:14.164918 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.165658 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.167680 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.168483 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.168715 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.168805 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.169211 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.169350 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 02:43:14.169642 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.162793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:43585 (local address 127.10.20.67:39867)
0808 02:43:14.163069 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.163078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.163993 (+ 915us) server_negotiation.cc:407] Connection header received
0808 02:43:14.164220 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.164225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.164286 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.164392 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:14.165139 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.165899 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.167722 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.168507 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.168721 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.168809 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.169229 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.169362 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 02:43:14.169934 30029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.162339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:39867 (local address 127.10.20.66:43585)
0808 02:43:14.163887 (+ 1548us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:14.163901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:14.164053 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:14.164407 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:14.164415 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:14.164449 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:14.164966 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.164978 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.166051 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.166057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.167548 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.167561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.168805 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.168811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.169011 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.169086 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 02:43:14.169200 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 02:43:14.169337 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1393,"mutex_wait_us":52,"thread_start_us":825,"threads_started":1}
I20260808 02:43:14.169982 30030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.162305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:40147 (local address 127.10.20.66:55831)
0808 02:43:14.163646 (+ 1341us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:14.163677 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:14.163910 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:14.164280 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:14.164284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:14.164308 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:14.164725 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.164736 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.165805 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.165812 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.167488 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:14.167505 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.168780 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.168790 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:14.168965 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.169060 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 02:43:14.169173 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 02:43:14.169322 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1135,"mutex_wait_us":44,"thread_start_us":1186,"threads_started":1}
I20260808 02:43:14.171191 29665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2471251d3a4514b329d382278d8e69" candidate_uuid: "30900f1928b847358e14430744e3fae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d0cba23ae14423b74bd850b77e3c82" is_pre_election: true
I20260808 02:43:14.171191 29952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2471251d3a4514b329d382278d8e69" candidate_uuid: "30900f1928b847358e14430744e3fae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a4e40754864c719e273a4bf598e03d" is_pre_election: true
I20260808 02:43:14.171854 29952 raft_consensus.cc:2454] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30900f1928b847358e14430744e3fae3 in term 0.
I20260808 02:43:14.171854 29665 raft_consensus.cc:2454] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30900f1928b847358e14430744e3fae3 in term 0.
I20260808 02:43:14.172803 29738 leader_election.cc:302] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d0cba23ae14423b74bd850b77e3c82, 30900f1928b847358e14430744e3fae3; no voters:
I20260808 02:43:14.173291 30028 raft_consensus.cc:2781] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:43:14.173477 30028 raft_consensus.cc:482] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:43:14.173609 30028 raft_consensus.cc:3037] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:14.176074 30028 raft_consensus.cc:504] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.176761 30028 leader_election.cc:288] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [CANDIDATE]: Term 1 election: Requested vote from peers 10d0cba23ae14423b74bd850b77e3c82 (127.10.20.65:40147), 75a4e40754864c719e273a4bf598e03d (127.10.20.67:39867)
I20260808 02:43:14.177364 29665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2471251d3a4514b329d382278d8e69" candidate_uuid: "30900f1928b847358e14430744e3fae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d0cba23ae14423b74bd850b77e3c82"
I20260808 02:43:14.177377 29952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc2471251d3a4514b329d382278d8e69" candidate_uuid: "30900f1928b847358e14430744e3fae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a4e40754864c719e273a4bf598e03d"
I20260808 02:43:14.177592 29665 raft_consensus.cc:3037] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:14.177625 29952 raft_consensus.cc:3037] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:14.180044 29665 raft_consensus.cc:2454] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30900f1928b847358e14430744e3fae3 in term 1.
I20260808 02:43:14.180056 29952 raft_consensus.cc:2454] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30900f1928b847358e14430744e3fae3 in term 1.
I20260808 02:43:14.180588 29738 leader_election.cc:302] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d0cba23ae14423b74bd850b77e3c82, 30900f1928b847358e14430744e3fae3; no voters:
I20260808 02:43:14.180955 30028 raft_consensus.cc:2781] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:14.181528 30028 raft_consensus.cc:686] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 1 LEADER]: Becoming Leader. State: Replica: 30900f1928b847358e14430744e3fae3, State: Running, Role: LEADER
I20260808 02:43:14.182111 30028 consensus_queue.cc:237] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } }
I20260808 02:43:14.187435 29511 catalog_manager.cc:5495] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30900f1928b847358e14430744e3fae3 (127.10.20.66). New cstate: current_term: 1 leader_uuid: "30900f1928b847358e14430744e3fae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30900f1928b847358e14430744e3fae3" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 39907 } health_report { overall_health: HEALTHY } } }
W20260808 02:43:14.201458 29715 tablet.cc:2369] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:14.208624 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.202534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.10.20.66:39907)
0808 02:43:14.202810 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.202815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.202834 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:43:14.203079 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.203084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.203172 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.203311 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:43:14.203737 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.204545 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.206063 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.206460 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.206559 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.207220 (+ 661us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:43:14.207734 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:43:14.207886 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.208220 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.208290 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:43:14.217329 29665 raft_consensus.cc:1261] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 1 FOLLOWER]: Refusing update from remote peer 30900f1928b847358e14430744e3fae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:14.217350 29952 raft_consensus.cc:1261] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 1 FOLLOWER]: Refusing update from remote peer 30900f1928b847358e14430744e3fae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:14.218551 30031 consensus_queue.cc:1035] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a4e40754864c719e273a4bf598e03d" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 39867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:14.219064 30028 consensus_queue.cc:1035] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d0cba23ae14423b74bd850b77e3c82" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:14.232761 30034 mvcc.cc:205] Tried to move back new op lower bound from 7316099048303443968 to 7316099048174874624. Current Snapshot: MvccSnapshot[applied={T|T < 7316099048303443968}]
I20260808 02:43:14.249694 29511 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:14.250010 29511 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:14.254110 29511 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee6d2e31be1a4f60ab28b852edc29784: Sending DeleteTablet for 3 replicas of tablet cc2471251d3a4514b329d382278d8e69
I20260808 02:43:14.255659 29931 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2471251d3a4514b329d382278d8e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:14 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:57502
I20260808 02:43:14.256388 29645 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2471251d3a4514b329d382278d8e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:14 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:57628
I20260808 02:43:14.256851 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 29577
I20260808 02:43:14.257221 29785 tablet_service.cc:1514] Processing DeleteTablet for tablet cc2471251d3a4514b329d382278d8e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:14 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:33720
I20260808 02:43:14.268278 30044 tablet_replica.cc:330] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: stopping tablet replica
I20260808 02:43:14.268923 30044 raft_consensus.cc:2229] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:14.269611 30044 raft_consensus.cc:2258] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:14.270780 30045 tablet_replica.cc:330] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: stopping tablet replica
I20260808 02:43:14.271397 30045 raft_consensus.cc:2229] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:14.272099 30045 raft_consensus.cc:2258] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:14.273393 30046 tablet_replica.cc:330] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: stopping tablet replica
I20260808 02:43:14.273931 30046 raft_consensus.cc:2229] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:43:14.274881 30045 ts_tablet_manager.cc:1905] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:14.276058 30044 ts_tablet_manager.cc:1905] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:14.277057 30046 raft_consensus.cc:2258] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 02:43:14 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:43:14.282588 30045 ts_tablet_manager.cc:1918] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:14.282964 30045 log.cc:1196] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/cc2471251d3a4514b329d382278d8e69
I20260808 02:43:14.283648 30045 ts_tablet_manager.cc:1939] T cc2471251d3a4514b329d382278d8e69 P 10d0cba23ae14423b74bd850b77e3c82: Deleting consensus metadata
I20260808 02:43:14.284013 30046 ts_tablet_manager.cc:1905] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:14.285967 29496 catalog_manager.cc:4841] TS 10d0cba23ae14423b74bd850b77e3c82 (127.10.20.65:40147): tablet cc2471251d3a4514b329d382278d8e69 (table test-table [id=b7167dcdd9584d86a8bb77ac3d28fe8a]) successfully deleted
I20260808 02:43:14.291779 30015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.258347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57638 (local address 127.10.20.65:40147)
0808 02:43:14.258534 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.258541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.269899 (+ 11358us) server_negotiation.cc:407] Connection header received
0808 02:43:14.270716 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.270723 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.270848 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.270935 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:14.272986 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.274183 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.276282 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.277171 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.277296 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.283599 (+ 6303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:14.283617 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:14.283641 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:14.283693 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:14.287952 (+ 4259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:14.289018 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:14.289028 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:14.289032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:14.289222 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:14.289692 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:14.289699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:14.289703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:14.290198 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:14.290527 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.290891 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.291144 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:43:14.292519 29709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:14.295511 30044 ts_tablet_manager.cc:1918] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:14.295971 30044 log.cc:1196] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/cc2471251d3a4514b329d382278d8e69
I20260808 02:43:14.296736 30044 ts_tablet_manager.cc:1939] T cc2471251d3a4514b329d382278d8e69 P 75a4e40754864c719e273a4bf598e03d: Deleting consensus metadata
I20260808 02:43:14.299098 29497 catalog_manager.cc:4841] TS 75a4e40754864c719e273a4bf598e03d (127.10.20.67:39867): tablet cc2471251d3a4514b329d382278d8e69 (table test-table [id=b7167dcdd9584d86a8bb77ac3d28fe8a]) successfully deleted
I20260808 02:43:14.299271 30046 ts_tablet_manager.cc:1918] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:14.299485 30046 log.cc:1196] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/cc2471251d3a4514b329d382278d8e69
I20260808 02:43:14.300153 30046 ts_tablet_manager.cc:1939] T cc2471251d3a4514b329d382278d8e69 P 30900f1928b847358e14430744e3fae3: Deleting consensus metadata
I20260808 02:43:14.302418 29496 catalog_manager.cc:4841] TS 30900f1928b847358e14430744e3fae3 (127.10.20.66:39907): tablet cc2471251d3a4514b329d382278d8e69 (table test-table [id=b7167dcdd9584d86a8bb77ac3d28fe8a]) successfully deleted
I20260808 02:43:14.407958 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 29577
I20260808 02:43:14.429471 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 29720
Aug 08 02:43:14 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:43:14.447964 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.430530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58612 (local address 127.10.20.66:39907)
0808 02:43:14.430777 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.430782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.430798 (+ 16us) server_negotiation.cc:407] Connection header received
0808 02:43:14.430853 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.430857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.430919 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.431036 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:14.432455 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.433361 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.434770 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.435252 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.435406 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.440506 (+ 5100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:14.440526 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:14.440543 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:14.440584 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:14.444377 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:14.445257 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:14.445266 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:14.445269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:14.445446 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:14.445927 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:14.445933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:14.445942 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:14.446389 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:14.446850 (+ 461us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.447233 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.447535 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:43:14.448792 29853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:14.573012 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 29720
I20260808 02:43:14.596062 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 29865
Aug 08 02:43:14 dist-test-slave-8tdl krb5kdc[29462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:43:14.614519 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:14.597035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.10.20.67:39867)
0808 02:43:14.597232 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:14.597237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:14.597257 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:43:14.597583 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:14.597589 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:14.597669 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:14.597772 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:14.599311 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.600142 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.601478 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:14.601907 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:14.602031 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:14.607909 (+ 5878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:14.607929 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:14.607947 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:14.608003 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:14.611251 (+ 3248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:14.612150 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:14.612163 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:14.612165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:14.612344 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:14.612861 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:14.612865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:14.612867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:14.613259 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:14.613531 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:14.614045 (+ 514us) server_negotiation.cc:299] Negotiation successful
0808 02:43:14.614238 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:43:14.615269 29995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:14.711941 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 29865
I20260808 02:43:14.732581 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 29476
I20260808 02:43:14.733945 29544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:14.853013 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 29476
2026-08-08T02:43:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4940 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T02:43:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:14Z Disabled control of system clock
I20260808 02:43:14.960218 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37893
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:43:15.336901 30055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:15.337333 30055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:15.337512 30055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:15.345314 30055 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:15.345532 30055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:15.345610 30055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:15.345712 30055 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:15.345805 30055 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:15.355907 30055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37893
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:15.357476 30055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:15.359660 30055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:15.373768 30060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:15.374336 30061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:15.374354 30063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:15.374838 30055 server_base.cc:1034] running on GCE node
I20260808 02:43:15.375854 30055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:15.377629 30055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:15.378858 30055 hybrid_clock.cc:648] HybridClock initialized: now 1786156995378794 us; error 63 us; skew 500 ppm
I20260808 02:43:15.379295 30055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:15.382143 30055 webserver.cc:460] Webserver started at http://127.10.20.126:38283/ using document root <none> and password file <none>
I20260808 02:43:15.383013 30055 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:15.383126 30055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:15.383419 30055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:15.386806 30055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "91fde4e5444d45ebb5d23096b09ad609"
format_stamp: "Formatted at 2026-08-08 02:43:15 on dist-test-slave-8tdl"
server_key: "1ea1eef1d8c14c9dc91e3eb21abcb0ff"
server_key_iv: "d1befa49566f2b515f856d3fbe65baa7"
server_key_version: "encryptionkey@0"
I20260808 02:43:15.387733 30055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "91fde4e5444d45ebb5d23096b09ad609"
format_stamp: "Formatted at 2026-08-08 02:43:15 on dist-test-slave-8tdl"
server_key: "1ea1eef1d8c14c9dc91e3eb21abcb0ff"
server_key_iv: "d1befa49566f2b515f856d3fbe65baa7"
server_key_version: "encryptionkey@0"
I20260808 02:43:15.394042 30055 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:43:15.398130 30069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:15.399974 30055 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:15.400223 30055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "91fde4e5444d45ebb5d23096b09ad609"
format_stamp: "Formatted at 2026-08-08 02:43:15 on dist-test-slave-8tdl"
server_key: "1ea1eef1d8c14c9dc91e3eb21abcb0ff"
server_key_iv: "d1befa49566f2b515f856d3fbe65baa7"
server_key_version: "encryptionkey@0"
I20260808 02:43:15.400499 30055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:15.431843 30055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:15.432819 30055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:15.433168 30055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:15.454872 30055 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:37893
I20260808 02:43:15.454928 30125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:37893 every 8 connection(s)
I20260808 02:43:15.456390 30055 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:15.458496 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30055
I20260808 02:43:15.458747 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:15.459278 10321 external_mini_cluster.cc:1428] Setting key 348bc4dbf2eb66b7e334149830969ad5
I20260808 02:43:15.461282 30126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:15.476832 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:15.461631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58662 (local address 127.10.20.126:37893)
0808 02:43:15.462848 (+ 1217us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:15.462874 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:15.462931 (+ 57us) server_negotiation.cc:407] Connection header received
0808 02:43:15.464927 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:15.464957 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:15.465652 (+ 695us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:15.466155 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:15.466763 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:15.468920 (+ 2157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:15.470509 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:15.471653 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:15.471896 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:15.473350 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:15.473364 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:15.473387 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:15.474258 (+ 871us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:15.474377 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:15.474418 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:15.474547 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:15.474966 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 02:43:15.475394 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":397,"threads_started":1}
I20260808 02:43:15.477679 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609: Bootstrap starting.
I20260808 02:43:15.481374 30126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:15.482479 30126 log.cc:824] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:15.486083 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609: No bootstrap required, opened a new log
I20260808 02:43:15.494763 30126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fde4e5444d45ebb5d23096b09ad609" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37893 } }
I20260808 02:43:15.495244 30126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:15.495316 30126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fde4e5444d45ebb5d23096b09ad609, State: Initialized, Role: FOLLOWER
I20260808 02:43:15.495954 30126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fde4e5444d45ebb5d23096b09ad609" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37893 } }
I20260808 02:43:15.496186 30126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:15.496284 30126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:15.496429 30126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:15.499022 30126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fde4e5444d45ebb5d23096b09ad609" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37893 } }
I20260808 02:43:15.499639 30126 leader_election.cc:302] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91fde4e5444d45ebb5d23096b09ad609; no voters:
I20260808 02:43:15.500361 30126 leader_election.cc:288] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:15.500577 30131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:15.501368 30131 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [term 1 LEADER]: Becoming Leader. State: Replica: 91fde4e5444d45ebb5d23096b09ad609, State: Running, Role: LEADER
I20260808 02:43:15.501951 30131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fde4e5444d45ebb5d23096b09ad609" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37893 } }
I20260808 02:43:15.502769 30126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:15.505198 30132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91fde4e5444d45ebb5d23096b09ad609" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fde4e5444d45ebb5d23096b09ad609" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37893 } } }
I20260808 02:43:15.505772 30132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:15.505736 30133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91fde4e5444d45ebb5d23096b09ad609. Latest consensus state: current_term: 1 leader_uuid: "91fde4e5444d45ebb5d23096b09ad609" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fde4e5444d45ebb5d23096b09ad609" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37893 } } }
I20260808 02:43:15.506201 30133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:15.507422 30141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:15.513913 30141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:15.524505 30141 catalog_manager.cc:1347] Generated new cluster ID: c8055514dba5420ca1403d2b4fb67fe3
I20260808 02:43:15.524662 30141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:15.545377 30141 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:15.547374 30141 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:15.558984 30141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609: Generated new TSK 0
I20260808 02:43:15.560180 30141 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:15.567137 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37893
--builtin_ntp_servers=127.10.20.84:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:43:15.964097 30152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:15.964433 30152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:15.964581 30152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:15.972410 30152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:15.972535 30152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:15.972704 30152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:43:15.982800 30152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:15.984194 30152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:15.986078 30152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:16.000515 30161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:16.000586 30158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:16.002516 30159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:16.003162 30152 server_base.cc:1034] running on GCE node
I20260808 02:43:16.004247 30152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:16.005640 30152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:16.006910 30152 hybrid_clock.cc:648] HybridClock initialized: now 1786156996006849 us; error 71 us; skew 500 ppm
I20260808 02:43:16.007354 30152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:16.010404 30152 webserver.cc:460] Webserver started at http://127.10.20.65:43109/ using document root <none> and password file <none>
I20260808 02:43:16.011602 30152 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:16.011811 30152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:16.012178 30152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:16.015825 30152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "4f439c37cf5c4221bcb32e460f756907"
format_stamp: "Formatted at 2026-08-08 02:43:16 on dist-test-slave-8tdl"
server_key: "8dda23fd3c2ec5f53d981a4b777ffe95"
server_key_iv: "b395a6e766f9a41d932bdd117dcf9b8c"
server_key_version: "encryptionkey@0"
I20260808 02:43:16.016717 30152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "4f439c37cf5c4221bcb32e460f756907"
format_stamp: "Formatted at 2026-08-08 02:43:16 on dist-test-slave-8tdl"
server_key: "8dda23fd3c2ec5f53d981a4b777ffe95"
server_key_iv: "b395a6e766f9a41d932bdd117dcf9b8c"
server_key_version: "encryptionkey@0"
I20260808 02:43:16.022902 30152 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 02:43:16.027177 30168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:16.028836 30152 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:43:16.029019 30152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "4f439c37cf5c4221bcb32e460f756907"
format_stamp: "Formatted at 2026-08-08 02:43:16 on dist-test-slave-8tdl"
server_key: "8dda23fd3c2ec5f53d981a4b777ffe95"
server_key_iv: "b395a6e766f9a41d932bdd117dcf9b8c"
server_key_version: "encryptionkey@0"
I20260808 02:43:16.029232 30152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:16.044426 30152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:16.045524 30152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:16.045840 30152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:16.047051 30152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:16.048684 30152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:16.048789 30152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:16.048885 30152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:16.048947 30152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:16.086536 30152 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:41077
I20260808 02:43:16.086642 30288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:41077 every 8 connection(s)
I20260808 02:43:16.087998 30152 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:43:16.097510 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30152
I20260808 02:43:16.097724 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:43:16.098315 10321 external_mini_cluster.cc:1428] Setting key a7f009d71604efdf17b230615d55d4bf
I20260808 02:43:16.101482 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37893
--builtin_ntp_servers=127.10.20.84:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:43:16.102607 30292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:16.090908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:55161 (local address 127.10.20.126:37893)
0808 02:43:16.091427 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:16.091432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:16.092832 (+ 1400us) server_negotiation.cc:407] Connection header received
0808 02:43:16.094719 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:16.094727 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:16.094821 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:16.094964 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:16.096148 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.096900 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.099366 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.099892 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.100041 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:16.101623 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:16.101633 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:16.101638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:16.101663 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:16.101728 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:16.101751 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:16.101868 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:16.102118 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 02:43:16.102230 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":406,"thread_start_us":280,"threads_started":1}
I20260808 02:43:16.103976 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:16.091648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37893 (local address 127.10.20.65:55161)
0808 02:43:16.092660 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:16.092698 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:16.094384 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:16.095257 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:16.095266 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:16.095355 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:16.095958 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:16.095976 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.097104 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.097112 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:16.099191 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:16.099212 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.100179 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.100186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:16.100425 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:16.101190 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:16.101193 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:16.101239 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:16.101323 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:16.101869 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:16.101883 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:16.101894 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 02:43:16.102105 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 02:43:16.102578 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":353,"threads_started":1}
I20260808 02:43:16.105901 30289 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37893
I20260808 02:43:16.106244 30289 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:16.107239 30289 heartbeater.cc:511] Master 127.10.20.126:37893 requested a full tablet report, sending...
I20260808 02:43:16.109885 30087 ts_manager.cc:194] Registered new tserver with Master: 4f439c37cf5c4221bcb32e460f756907 (127.10.20.65:41077)
I20260808 02:43:16.112213 30087 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.65:55161
W20260808 02:43:16.478525 30294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:16.478905 30294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:16.479127 30294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:16.487533 30294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:16.487679 30294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:16.487898 30294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:43:16.498659 30294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:16.500200 30294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:16.502163 30294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:16.517511 30299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:16.517731 30302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:16.517800 30300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:16.519984 30294 server_base.cc:1034] running on GCE node
I20260808 02:43:16.520735 30294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:16.521883 30294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:16.523170 30294 hybrid_clock.cc:648] HybridClock initialized: now 1786156996523131 us; error 37 us; skew 500 ppm
I20260808 02:43:16.523562 30294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:16.526350 30294 webserver.cc:460] Webserver started at http://127.10.20.66:44277/ using document root <none> and password file <none>
I20260808 02:43:16.527274 30294 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:16.527426 30294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:16.527776 30294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:16.531026 30294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "4970eceb82444f5e8cf8e35ae04eaaa9"
format_stamp: "Formatted at 2026-08-08 02:43:16 on dist-test-slave-8tdl"
server_key: "d4c4bb82c339adaf095643f1f3a8924c"
server_key_iv: "c10017f8e28fdf740e4f4c4a7207bd9e"
server_key_version: "encryptionkey@0"
I20260808 02:43:16.531893 30294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "4970eceb82444f5e8cf8e35ae04eaaa9"
format_stamp: "Formatted at 2026-08-08 02:43:16 on dist-test-slave-8tdl"
server_key: "d4c4bb82c339adaf095643f1f3a8924c"
server_key_iv: "c10017f8e28fdf740e4f4c4a7207bd9e"
server_key_version: "encryptionkey@0"
I20260808 02:43:16.537731 30294 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 02:43:16.541899 30308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:16.543579 30294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:43:16.543792 30294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "4970eceb82444f5e8cf8e35ae04eaaa9"
format_stamp: "Formatted at 2026-08-08 02:43:16 on dist-test-slave-8tdl"
server_key: "d4c4bb82c339adaf095643f1f3a8924c"
server_key_iv: "c10017f8e28fdf740e4f4c4a7207bd9e"
server_key_version: "encryptionkey@0"
I20260808 02:43:16.544075 30294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:16.568735 30294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:16.569726 30294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:16.570107 30294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:16.571269 30294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:16.572835 30294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:16.572934 30294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:16.573010 30294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:16.573058 30294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:16.610807 30294 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:38539
I20260808 02:43:16.610914 30427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:38539 every 8 connection(s)
I20260808 02:43:16.612313 30294 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:43:16.621592 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30294
I20260808 02:43:16.621803 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:43:16.622324 10321 external_mini_cluster.cc:1428] Setting key feee91a8e9138785237c69dbd982b866
I20260808 02:43:16.625815 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37893
--builtin_ntp_servers=127.10.20.84:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:43:16.627961 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:16.615413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:40499 (local address 127.10.20.126:37893)
0808 02:43:16.616036 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:16.616041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:16.617285 (+ 1244us) server_negotiation.cc:407] Connection header received
0808 02:43:16.619306 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:16.619313 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:16.619424 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:16.619557 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:16.620803 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.621885 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.624358 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.624932 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.625082 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:16.626657 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:16.626666 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:16.626697 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:16.626728 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:16.626789 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:16.626810 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:16.626912 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:16.627338 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 02:43:16.627470 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":289,"threads_started":1}
I20260808 02:43:16.628907 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:16.616067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37893 (local address 127.10.20.66:40499)
0808 02:43:16.617090 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:16.617138 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:16.618986 (+ 1848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:16.619818 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:16.619828 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:16.619936 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:16.620607 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:16.620626 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.622083 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.622087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:16.624141 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:16.624159 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:16.625202 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:16.625208 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:16.625457 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:16.626273 (+ 816us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:16.626276 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:16.626323 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:16.626425 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:16.627093 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:16.627103 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:16.627110 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 02:43:16.627289 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 02:43:16.627653 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":308,"threads_started":1}
I20260808 02:43:16.630708 30428 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37893
I20260808 02:43:16.631071 30428 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:16.632104 30428 heartbeater.cc:511] Master 127.10.20.126:37893 requested a full tablet report, sending...
I20260808 02:43:16.634024 30087 ts_manager.cc:194] Registered new tserver with Master: 4970eceb82444f5e8cf8e35ae04eaaa9 (127.10.20.66:38539)
I20260808 02:43:16.635010 30087 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.66:40499
W20260808 02:43:17.005663 30432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:17.006008 30432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:17.006184 30432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:17.014619 30432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:17.014822 30432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:17.015014 30432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:43:17.024988 30432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:37893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:17.026412 30432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:17.028456 30432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:17.043361 30440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:17.043371 30442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:17.043411 30439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:17.044276 30432 server_base.cc:1034] running on GCE node
I20260808 02:43:17.044974 30432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:17.046083 30432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:17.047334 30432 hybrid_clock.cc:648] HybridClock initialized: now 1786156997047281 us; error 49 us; skew 500 ppm
I20260808 02:43:17.047698 30432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:17.054248 30432 webserver.cc:460] Webserver started at http://127.10.20.67:45905/ using document root <none> and password file <none>
I20260808 02:43:17.055246 30432 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:17.055400 30432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:17.055749 30432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:17.059407 30432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd"
format_stamp: "Formatted at 2026-08-08 02:43:17 on dist-test-slave-8tdl"
server_key: "d9f45d74a95afe33c5d9645c4c2792ca"
server_key_iv: "4e8b8b1da1c647c9fcb76b6ad2c4a15f"
server_key_version: "encryptionkey@0"
I20260808 02:43:17.060434 30432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd"
format_stamp: "Formatted at 2026-08-08 02:43:17 on dist-test-slave-8tdl"
server_key: "d9f45d74a95afe33c5d9645c4c2792ca"
server_key_iv: "4e8b8b1da1c647c9fcb76b6ad2c4a15f"
server_key_version: "encryptionkey@0"
I20260808 02:43:17.066793 30432 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 02:43:17.070890 30448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:17.072432 30432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 02:43:17.072649 30432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd"
format_stamp: "Formatted at 2026-08-08 02:43:17 on dist-test-slave-8tdl"
server_key: "d9f45d74a95afe33c5d9645c4c2792ca"
server_key_iv: "4e8b8b1da1c647c9fcb76b6ad2c4a15f"
server_key_version: "encryptionkey@0"
I20260808 02:43:17.072902 30432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:17.091193 30432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:17.092118 30432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:17.092465 30432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:17.093570 30432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:17.095278 30432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:17.095417 30432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:17.095556 30432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:17.095650 30432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:17.116140 30289 heartbeater.cc:503] Master 127.10.20.126:37893 was elected leader, sending a full tablet report...
I20260808 02:43:17.134375 30432 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:38419
I20260808 02:43:17.134418 30564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:38419 every 8 connection(s)
I20260808 02:43:17.135949 30432 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:43:17.137068 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30432
I20260808 02:43:17.137305 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:43:17.137935 10321 external_mini_cluster.cc:1428] Setting key f3de775e8370d419eff34e76660db8e0
I20260808 02:43:17.151275 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.139151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:40549 (local address 127.10.20.126:37893)
0808 02:43:17.141661 (+ 2510us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.141668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.141692 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:43:17.143544 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.143550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.143666 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.143801 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:17.145048 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.145894 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.147773 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.148293 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.148445 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.150159 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:17.150165 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:17.150169 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:17.150192 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:17.150240 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:17.150254 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:17.150365 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.150664 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.150823 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2368,"thread_start_us":2235,"threads_started":1}
I20260808 02:43:17.152405 30568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.139869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:37893 (local address 127.10.20.67:40549)
0808 02:43:17.141141 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.141206 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:17.143241 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:17.144066 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:17.144075 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:17.144174 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:17.144829 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.144851 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.146074 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.146084 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.147596 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.147610 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.148557 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.148565 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.148854 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.149753 (+ 899us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:17.149756 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:17.149805 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:17.149913 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:17.150404 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:17.150419 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:17.150432 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 02:43:17.150650 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 02:43:17.151193 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":476,"threads_started":1}
I20260808 02:43:17.154083 30565 heartbeater.cc:347] Connected to a master server at 127.10.20.126:37893
I20260808 02:43:17.154497 30565 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:17.155929 30565 heartbeater.cc:511] Master 127.10.20.126:37893 requested a full tablet report, sending...
I20260808 02:43:17.157740 30087 ts_manager.cc:194] Registered new tserver with Master: 8e11d5fdd1e44df994d2ac4fcc80e1bd (127.10.20.67:38419)
I20260808 02:43:17.158851 30087 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.67:40549
I20260808 02:43:17.169592 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:43:17.181797 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.174469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58678 (local address 127.10.20.126:37893)
0808 02:43:17.174778 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.174786 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.175139 (+ 353us) server_negotiation.cc:407] Connection header received
0808 02:43:17.175368 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.175373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.175466 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.175588 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:17.176240 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.177155 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.179026 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.179514 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.179664 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.180983 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:17.180988 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:17.180991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:17.181013 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:17.181048 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:17.181061 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:17.181223 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.181430 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.181527 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 02:43:17.186861 30087 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:43:17.194103 30087 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:43:17.225083 30579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.208760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54426 (local address 127.10.20.66:38539)
0808 02:43:17.216210 (+ 7450us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.216225 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.216250 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:43:17.216331 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.216337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.216613 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.217710 (+ 1097us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:17.217983 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.219398 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.222733 (+ 3335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.223729 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.223890 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.224194 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.224487 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.224678 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7290,"thread_start_us":7164,"threads_started":1}
I20260808 02:43:17.225099 30578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.208462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:38539 (local address 127.0.0.1:54426)
0808 02:43:17.209302 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.209340 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:17.209531 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:17.216886 (+ 7355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:17.216895 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:17.216927 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:17.217456 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.217491 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.219564 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.219571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.222384 (+ 2813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.222397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.223954 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.223960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.224220 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.224289 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 02:43:17.224443 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 02:43:17.224678 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":136,"thread_start_us":362,"threads_started":1}
I20260808 02:43:17.225646 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.210417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34214 (local address 127.10.20.67:38419)
0808 02:43:17.215365 (+ 4948us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.215376 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.215423 (+ 47us) server_negotiation.cc:407] Connection header received
0808 02:43:17.215562 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.215571 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.215901 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.216965 (+ 1064us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:17.217274 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.218967 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.222135 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.223828 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.224645 (+ 817us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.224939 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.225030 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.225206 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4754,"thread_start_us":4574,"threads_started":1}
I20260808 02:43:17.226061 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.210938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.10.20.65:41077)
0808 02:43:17.211767 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.211781 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.215828 (+ 4047us) server_negotiation.cc:407] Connection header received
0808 02:43:17.216185 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.216195 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.216411 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.216601 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:17.217792 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.219280 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.222652 (+ 3372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.224335 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.224497 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.224791 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.225378 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.225611 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":371,"threads_started":1}
I20260808 02:43:17.226287 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.209671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:38419 (local address 127.0.0.1:34214)
0808 02:43:17.210323 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.210342 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:17.210455 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:17.216199 (+ 5744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:17.216207 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:17.216239 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:17.216722 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.216741 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.219116 (+ 2375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.219122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.221821 (+ 2699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.221838 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.224125 (+ 2287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.224132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.224376 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.224433 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 02:43:17.224502 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 02:43:17.225887 (+ 1385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":1171,"thread_start_us":1052,"threads_started":1}
I20260808 02:43:17.226950 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.210005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:40918)
0808 02:43:17.215683 (+ 5678us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.215704 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:17.215956 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:17.216921 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:17.216925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:17.216968 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:17.217545 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.217563 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.219429 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.219436 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.222380 (+ 2944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.222397 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.224939 (+ 2542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.224946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.225149 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.225184 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:43:17.226342 (+ 1158us) client_negotiation.cc:240] Negotiation successful
0808 02:43:17.226519 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5545,"mutex_wait_us":199,"spinlock_wait_cycles":4096,"thread_start_us":5386,"threads_started":1}
I20260808 02:43:17.230453 30499 tablet_service.cc:1467] Processing CreateTablet for tablet 96a26d68139e400bae90ddde20111585 (DEFAULT_TABLE table=test-table [id=0bd30d35e15745549787ea2470096214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:17.230470 30219 tablet_service.cc:1467] Processing CreateTablet for tablet 96a26d68139e400bae90ddde20111585 (DEFAULT_TABLE table=test-table [id=0bd30d35e15745549787ea2470096214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:17.230468 30362 tablet_service.cc:1467] Processing CreateTablet for tablet 96a26d68139e400bae90ddde20111585 (DEFAULT_TABLE table=test-table [id=0bd30d35e15745549787ea2470096214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:17.231911 30499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a26d68139e400bae90ddde20111585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:17.231947 30219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a26d68139e400bae90ddde20111585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:17.231966 30362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a26d68139e400bae90ddde20111585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:17.244822 30585 tablet_bootstrap.cc:492] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Bootstrap starting.
I20260808 02:43:17.247303 30586 tablet_bootstrap.cc:492] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Bootstrap starting.
I20260808 02:43:17.250808 30585 tablet_bootstrap.cc:654] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:17.251140 30586 tablet_bootstrap.cc:654] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:17.251670 30587 tablet_bootstrap.cc:492] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Bootstrap starting.
I20260808 02:43:17.252462 30585 log.cc:824] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:17.252460 30586 log.cc:824] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:17.255450 30587 tablet_bootstrap.cc:654] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:17.255973 30585 tablet_bootstrap.cc:492] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: No bootstrap required, opened a new log
I20260808 02:43:17.256157 30586 tablet_bootstrap.cc:492] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: No bootstrap required, opened a new log
I20260808 02:43:17.256274 30585 ts_tablet_manager.cc:1397] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20260808 02:43:17.256487 30586 ts_tablet_manager.cc:1397] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 02:43:17.256779 30587 log.cc:824] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:17.260509 30587 tablet_bootstrap.cc:492] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: No bootstrap required, opened a new log
I20260808 02:43:17.260814 30587 ts_tablet_manager.cc:1397] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 02:43:17.264698 30585 raft_consensus.cc:348] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.265182 30585 raft_consensus.cc:374] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:17.265280 30585 raft_consensus.cc:729] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e11d5fdd1e44df994d2ac4fcc80e1bd, State: Initialized, Role: FOLLOWER
I20260808 02:43:17.266003 30585 consensus_queue.cc:260] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.267371 30586 raft_consensus.cc:348] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.267863 30586 raft_consensus.cc:374] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:17.267956 30586 raft_consensus.cc:729] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4970eceb82444f5e8cf8e35ae04eaaa9, State: Initialized, Role: FOLLOWER
I20260808 02:43:17.268199 30585 ts_tablet_manager.cc:1428] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260808 02:43:17.268744 30586 consensus_queue.cc:260] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.269639 30565 heartbeater.cc:503] Master 127.10.20.126:37893 was elected leader, sending a full tablet report...
I20260808 02:43:17.271236 30428 heartbeater.cc:503] Master 127.10.20.126:37893 was elected leader, sending a full tablet report...
I20260808 02:43:17.272154 30586 ts_tablet_manager.cc:1428] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260808 02:43:17.272667 30587 raft_consensus.cc:348] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.273146 30587 raft_consensus.cc:374] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:17.273262 30587 raft_consensus.cc:729] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f439c37cf5c4221bcb32e460f756907, State: Initialized, Role: FOLLOWER
I20260808 02:43:17.273962 30587 consensus_queue.cc:260] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.276034 30587 ts_tablet_manager.cc:1428] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260808 02:43:17.290771 30592 raft_consensus.cc:482] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:43:17.291193 30592 raft_consensus.cc:504] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.293012 30592 leader_election.cc:288] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4970eceb82444f5e8cf8e35ae04eaaa9 (127.10.20.66:38539), 4f439c37cf5c4221bcb32e460f756907 (127.10.20.65:41077)
I20260808 02:43:17.300551 30568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.293583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.10.20.67:60701)
0808 02:43:17.293741 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.293764 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:17.293914 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:17.294394 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:17.294399 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:17.294432 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:17.294655 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.294671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.296007 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.296011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.298062 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.298078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.299915 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.299939 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.300099 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.300125 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 02:43:17.300202 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 02:43:17.300307 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 02:43:17.300648 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.293494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:60701 (local address 127.10.20.65:41077)
0808 02:43:17.293702 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.293709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.293864 (+ 155us) server_negotiation.cc:407] Connection header received
0808 02:43:17.294075 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.294083 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.294208 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.294331 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:17.294912 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.295865 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.298269 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.299732 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.299930 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.300008 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.300257 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.300405 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:43:17.301786 30240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a26d68139e400bae90ddde20111585" candidate_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f439c37cf5c4221bcb32e460f756907" is_pre_election: true
I20260808 02:43:17.302215 30579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.293496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:36225 (local address 127.10.20.66:38539)
0808 02:43:17.293702 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.293709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.294783 (+ 1074us) server_negotiation.cc:407] Connection header received
0808 02:43:17.294890 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.294896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.295007 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.295120 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:17.295617 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.296413 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.300003 (+ 3590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.301205 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.301367 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.301417 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.301925 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.302032 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 02:43:17.302328 30596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.293583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:38539 (local address 127.10.20.67:36225)
0808 02:43:17.294585 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.294606 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:17.294752 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:17.295142 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:17.295145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:17.295165 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:17.295459 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.295467 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.296575 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.296580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.298611 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:17.298623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.301457 (+ 2834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.301465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:17.301652 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.301687 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 02:43:17.301798 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 02:43:17.301962 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"mutex_wait_us":151,"thread_start_us":415,"threads_started":1}
I20260808 02:43:17.302527 30240 raft_consensus.cc:2454] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e11d5fdd1e44df994d2ac4fcc80e1bd in term 0.
I20260808 02:43:17.303484 30449 leader_election.cc:302] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f439c37cf5c4221bcb32e460f756907, 8e11d5fdd1e44df994d2ac4fcc80e1bd; no voters:
I20260808 02:43:17.303401 30383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a26d68139e400bae90ddde20111585" candidate_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" is_pre_election: true
I20260808 02:43:17.303917 30592 raft_consensus.cc:2781] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:43:17.303938 30383 raft_consensus.cc:2454] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e11d5fdd1e44df994d2ac4fcc80e1bd in term 0.
I20260808 02:43:17.304072 30592 raft_consensus.cc:482] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:43:17.304157 30592 raft_consensus.cc:3037] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:17.306597 30592 raft_consensus.cc:504] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.307271 30592 leader_election.cc:288] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [CANDIDATE]: Term 1 election: Requested vote from peers 4970eceb82444f5e8cf8e35ae04eaaa9 (127.10.20.66:38539), 4f439c37cf5c4221bcb32e460f756907 (127.10.20.65:41077)
I20260808 02:43:17.307946 30383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a26d68139e400bae90ddde20111585" candidate_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9"
I20260808 02:43:17.308218 30383 raft_consensus.cc:3037] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:17.311028 30383 raft_consensus.cc:2454] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e11d5fdd1e44df994d2ac4fcc80e1bd in term 1.
I20260808 02:43:17.310989 30240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a26d68139e400bae90ddde20111585" candidate_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f439c37cf5c4221bcb32e460f756907"
I20260808 02:43:17.311259 30240 raft_consensus.cc:3037] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:17.311599 30452 leader_election.cc:302] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4970eceb82444f5e8cf8e35ae04eaaa9, 8e11d5fdd1e44df994d2ac4fcc80e1bd; no voters:
I20260808 02:43:17.311995 30592 raft_consensus.cc:2781] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:17.312536 30592 raft_consensus.cc:686] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 1 LEADER]: Becoming Leader. State: Replica: 8e11d5fdd1e44df994d2ac4fcc80e1bd, State: Running, Role: LEADER
I20260808 02:43:17.313139 30592 consensus_queue.cc:237] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } }
I20260808 02:43:17.314836 30240 raft_consensus.cc:2454] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e11d5fdd1e44df994d2ac4fcc80e1bd in term 1.
I20260808 02:43:17.318738 30086 catalog_manager.cc:5495] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e11d5fdd1e44df994d2ac4fcc80e1bd (127.10.20.67). New cstate: current_term: 1 leader_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e11d5fdd1e44df994d2ac4fcc80e1bd" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 } health_report { overall_health: UNKNOWN } } }
W20260808 02:43:17.340869 30291 tablet.cc:2369] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:17.357553 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.351087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.10.20.67:38419)
0808 02:43:17.351385 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.351392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.351412 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:43:17.351670 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.351674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.351772 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.351973 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:43:17.352380 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.353314 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.354849 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.355297 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.355445 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.356043 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:43:17.356798 (+ 755us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:43:17.357020 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.357195 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.357242 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
W20260808 02:43:17.364821 30429 tablet.cc:2369] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:17.367180 30383 raft_consensus.cc:1261] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 1 FOLLOWER]: Refusing update from remote peer 8e11d5fdd1e44df994d2ac4fcc80e1bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:17.367213 30240 raft_consensus.cc:1261] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 1 FOLLOWER]: Refusing update from remote peer 8e11d5fdd1e44df994d2ac4fcc80e1bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:17.368208 30597 consensus_queue.cc:1035] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4970eceb82444f5e8cf8e35ae04eaaa9" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 38539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:17.368606 30592 consensus_queue.cc:1035] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f439c37cf5c4221bcb32e460f756907" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 41077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:17.400707 30087 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:17.401034 30087 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:17.405683 30087 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91fde4e5444d45ebb5d23096b09ad609: Sending DeleteTablet for 3 replicas of tablet 96a26d68139e400bae90ddde20111585
I20260808 02:43:17.407169 30499 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a26d68139e400bae90ddde20111585 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:17 UTC) from {username='slave'} at 127.0.0.1:34214
I20260808 02:43:17.407426 30219 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a26d68139e400bae90ddde20111585 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:17 UTC) from {username='slave'} at 127.0.0.1:40918
I20260808 02:43:17.408329 30362 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a26d68139e400bae90ddde20111585 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:17 UTC) from {username='slave'} at 127.0.0.1:54426
I20260808 02:43:17.409173 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30152
I20260808 02:43:17.423302 30612 tablet_replica.cc:330] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: stopping tablet replica
I20260808 02:43:17.424088 30612 raft_consensus.cc:2229] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:17.424870 30612 raft_consensus.cc:2258] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:17.427373 30612 ts_tablet_manager.cc:1905] T 96a26d68139e400bae90ddde20111585 P 4f439c37cf5c4221bcb32e460f756907: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:17.432865 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.411002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40930 (local address 127.10.20.65:41077)
0808 02:43:17.411221 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.411228 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.422109 (+ 10881us) server_negotiation.cc:407] Connection header received
0808 02:43:17.422390 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.422399 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.422557 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.422721 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:17.423465 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.424793 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.427707 (+ 2914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.428443 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.428564 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.430331 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:17.430344 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:17.430375 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:17.431302 (+ 927us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:17.431383 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:17.431412 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:17.431526 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.432256 (+ 730us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.432396 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 02:43:17.433780 30282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:17.434533 30613 tablet_replica.cc:330] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: stopping tablet replica
I20260808 02:43:17.435386 30613 raft_consensus.cc:2229] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:17.435977 30613 raft_consensus.cc:2258] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:17.436894 30611 tablet_replica.cc:330] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: stopping tablet replica
I20260808 02:43:17.437383 30611 raft_consensus.cc:2229] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:43:17.438064 30611 raft_consensus.cc:2258] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:17.439524 30613 ts_tablet_manager.cc:1905] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:17.440119 30611 ts_tablet_manager.cc:1905] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:17.448884 30611 ts_tablet_manager.cc:1918] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:17.449361 30611 log.cc:1196] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/96a26d68139e400bae90ddde20111585
I20260808 02:43:17.450145 30611 ts_tablet_manager.cc:1939] T 96a26d68139e400bae90ddde20111585 P 8e11d5fdd1e44df994d2ac4fcc80e1bd: Deleting consensus metadata
I20260808 02:43:17.451445 30613 ts_tablet_manager.cc:1918] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:17.451766 30613 log.cc:1196] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/96a26d68139e400bae90ddde20111585
I20260808 02:43:17.452451 30073 catalog_manager.cc:4841] TS 8e11d5fdd1e44df994d2ac4fcc80e1bd (127.10.20.67:38419): tablet 96a26d68139e400bae90ddde20111585 (table test-table [id=0bd30d35e15745549787ea2470096214]) successfully deleted
I20260808 02:43:17.452580 30613 ts_tablet_manager.cc:1939] T 96a26d68139e400bae90ddde20111585 P 4970eceb82444f5e8cf8e35ae04eaaa9: Deleting consensus metadata
I20260808 02:43:17.459261 30073 catalog_manager.cc:4841] TS 4970eceb82444f5e8cf8e35ae04eaaa9 (127.10.20.66:38539): tablet 96a26d68139e400bae90ddde20111585 (table test-table [id=0bd30d35e15745549787ea2470096214]) successfully deleted
I20260808 02:43:17.553112 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30152
I20260808 02:43:17.575693 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30294
W20260808 02:43:17.575805 30070 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.20.65:41077 (error 108)
I20260808 02:43:17.579697 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.579179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:40940)
0808 02:43:17.579384 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.579509 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 02:43:17.579985 30070 catalog_manager.cc:4584] TS 4f439c37cf5c4221bcb32e460f756907 (127.10.20.65:41077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 96a26d68139e400bae90ddde20111585: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
I20260808 02:43:17.584038 30579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.576973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54428 (local address 127.10.20.66:38539)
0808 02:43:17.577156 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.577163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.577184 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:43:17.577254 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.577259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.577388 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.577497 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:17.578149 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.579319 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.580823 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.581240 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.581384 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.582536 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:17.582544 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:17.582558 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:17.583233 (+ 675us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:17.583281 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:17.583300 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:17.583444 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.583577 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.583690 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 02:43:17.584748 30423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:17.633996 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.633352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:40956)
0808 02:43:17.633658 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.633788 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 02:43:17.635286 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.634856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:40968)
0808 02:43:17.635029 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.635138 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 02:43:17.678650 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30294
I20260808 02:43:17.696143 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.695465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:40980)
0808 02:43:17.695745 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.695883 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 02:43:17.697546 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.697082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:40996)
0808 02:43:17.697275 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.697384 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 02:43:17.701186 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30432
I20260808 02:43:17.710858 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.701988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34228 (local address 127.10.20.67:38419)
0808 02:43:17.702719 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:17.702739 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:17.702764 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:43:17.702827 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:17.702830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:17.702908 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:17.703001 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:17.703598 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.704654 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.706634 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:17.707493 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:17.707611 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:17.708963 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:17.708976 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:17.708998 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:17.709903 (+ 905us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:17.709968 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:17.710003 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:17.710142 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:17.710278 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 02:43:17.710401 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556}
I20260808 02:43:17.711781 30560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:17.778441 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.777842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:41002)
0808 02:43:17.778104 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.778235 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 02:43:17.779758 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.779263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:41004)
0808 02:43:17.779517 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.779610 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 02:43:17.842072 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30432
I20260808 02:43:17.866806 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30055
I20260808 02:43:17.868028 30121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:17.983243 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:17.982651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:41077 (local address 127.0.0.1:41016)
0808 02:43:17.982929 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:17.983057 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.65:41077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 02:43:17.984231 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30055
2026-08-08T02:43:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3129 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:18 dist-test-slave-8tdl krb5kdc[30622](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:18 dist-test-slave-8tdl krb5kdc[30622](info): set up 2 sockets
Aug 08 02:43:18 dist-test-slave-8tdl krb5kdc[30622](info): commencing operation
krb5kdc: starting...
W20260808 02:43:19.218670 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.005s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:19 dist-test-slave-8tdl krb5kdc[30622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:43:19.599200 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:43855
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:43855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:19.977444 30637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:19.977769 30637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:19.977906 30637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:19.986074 30637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:19.986229 30637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:19.986341 30637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:19.986464 30637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:19.986563 30637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:19.997443 30637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:43855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:43855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:19.999037 30637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:20.000594 30637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:20.016387 30642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:20.016408 30643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:20.016438 30645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:20.018798 30637 server_base.cc:1034] running on GCE node
I20260808 02:43:20.020181 30637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:20.022264 30637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:20.023581 30637 hybrid_clock.cc:648] HybridClock initialized: now 1786157000023447 us; error 166 us; skew 500 ppm
I20260808 02:43:20.024246 30637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:20 dist-test-slave-8tdl krb5kdc[30622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157000, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:20.028445 30637 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:43:20.030925 30637 webserver.cc:460] Webserver started at http://127.10.20.126:37057/ using document root <none> and password file <none>
I20260808 02:43:20.031876 30637 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:20.032065 30637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:20.032445 30637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:20.036268 30637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "dd2bb2b333234c00bcb8b2399a146a34"
format_stamp: "Formatted at 2026-08-08 02:43:20 on dist-test-slave-8tdl"
server_key: "9ca4893ba44c007d5716e5ae90e69f1a"
server_key_iv: "67c0ff2af138808fe82372918c4d9cf3"
server_key_version: "encryptionkey@0"
I20260808 02:43:20.037266 30637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "dd2bb2b333234c00bcb8b2399a146a34"
format_stamp: "Formatted at 2026-08-08 02:43:20 on dist-test-slave-8tdl"
server_key: "9ca4893ba44c007d5716e5ae90e69f1a"
server_key_iv: "67c0ff2af138808fe82372918c4d9cf3"
server_key_version: "encryptionkey@0"
I20260808 02:43:20.043794 30637 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 02:43:20.048146 30652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:20.049919 30637 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:43:20.050201 30637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "dd2bb2b333234c00bcb8b2399a146a34"
format_stamp: "Formatted at 2026-08-08 02:43:20 on dist-test-slave-8tdl"
server_key: "9ca4893ba44c007d5716e5ae90e69f1a"
server_key_iv: "67c0ff2af138808fe82372918c4d9cf3"
server_key_version: "encryptionkey@0"
I20260808 02:43:20.050459 30637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:20.065388 30637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:20.070887 30637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:20.071260 30637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:20.095000 30637 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:43855
I20260808 02:43:20.095019 30707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:43855 every 8 connection(s)
I20260808 02:43:20.096653 30637 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:20.097851 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30637
I20260808 02:43:20.098176 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:20.098814 10321 external_mini_cluster.cc:1428] Setting key b68ea3118e662a577d3ccf84baccb530
I20260808 02:43:20.102101 30708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:20.113898 30708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34: Bootstrap starting.
Aug 08 02:43:20 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:20.117615 30708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:20.119253 30708 log.cc:824] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:20.123226 30708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34: No bootstrap required, opened a new log
I20260808 02:43:20.126327 30712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:20.100981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41404 (local address 127.10.20.126:43855)
0808 02:43:20.101917 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:20.101930 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:20.102055 (+ 125us) server_negotiation.cc:407] Connection header received
0808 02:43:20.104203 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:20.104229 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:20.104673 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:20.105179 (+ 506us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:20.107004 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:20.108579 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:20.110362 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:20.111247 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:20.111502 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:20.116369 (+ 4867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:20.116378 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:20.116394 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:20.116443 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:20.120771 (+ 4328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:20.121671 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:20.121680 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:20.121689 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:20.122031 (+ 342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:20.122501 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:20.122507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:20.122510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:20.123420 (+ 910us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:20.123792 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:20.124260 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 02:43:20.124827 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":448,"threads_started":1}
I20260808 02:43:20.133117 30708 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2bb2b333234c00bcb8b2399a146a34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43855 } }
I20260808 02:43:20.133512 30708 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:20.133605 30708 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2bb2b333234c00bcb8b2399a146a34, State: Initialized, Role: FOLLOWER
I20260808 02:43:20.134132 30708 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2bb2b333234c00bcb8b2399a146a34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43855 } }
I20260808 02:43:20.134341 30708 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:20.134490 30708 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:20.134745 30708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:20.137465 30708 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2bb2b333234c00bcb8b2399a146a34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43855 } }
I20260808 02:43:20.138043 30708 leader_election.cc:302] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd2bb2b333234c00bcb8b2399a146a34; no voters:
I20260808 02:43:20.138953 30708 leader_election.cc:288] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:20.139142 30714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:20.139938 30714 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [term 1 LEADER]: Becoming Leader. State: Replica: dd2bb2b333234c00bcb8b2399a146a34, State: Running, Role: LEADER
I20260808 02:43:20.140494 30714 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2bb2b333234c00bcb8b2399a146a34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43855 } }
I20260808 02:43:20.141243 30708 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:20.143832 30716 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd2bb2b333234c00bcb8b2399a146a34. Latest consensus state: current_term: 1 leader_uuid: "dd2bb2b333234c00bcb8b2399a146a34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2bb2b333234c00bcb8b2399a146a34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43855 } } }
I20260808 02:43:20.144271 30716 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:20.144289 30715 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd2bb2b333234c00bcb8b2399a146a34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd2bb2b333234c00bcb8b2399a146a34" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43855 } } }
I20260808 02:43:20.145251 30715 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:20.146917 30723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:20.152335 30723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:20.162909 30723 catalog_manager.cc:1347] Generated new cluster ID: 89f061263b764bd0ab0ec66705f457df
I20260808 02:43:20.163105 30723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:20.181457 30723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:20.184297 30723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:20.196717 30723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34: Generated new TSK 0
I20260808 02:43:20.198043 30723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.20.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
Entry for principal kudu/127.10.20.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab.
I20260808 02:43:20.292068 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43855
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:20.674163 30736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:20.674539 30736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:20.674806 30736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:20.682751 30736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:20.682953 30736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:20.683163 30736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:43:20.693755 30736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.65.keytab
--principal=kudu/127.10.20.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:20.695336 30736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:20.696856 30736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:20.711871 30741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:20.711911 30742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:20.711907 30744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:20.712886 30736 server_base.cc:1034] running on GCE node
I20260808 02:43:20.713691 30736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:20.714864 30736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:20.716130 30736 hybrid_clock.cc:648] HybridClock initialized: now 1786157000716074 us; error 39 us; skew 500 ppm
I20260808 02:43:20.716590 30736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:20 dist-test-slave-8tdl krb5kdc[30622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157000, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:20.720567 30736 init.cc:377] Logged in from keytab as kudu/127.10.20.65@KRBTEST.COM (short username kudu)
I20260808 02:43:20.723353 30736 webserver.cc:460] Webserver started at http://127.10.20.65:33435/ using document root <none> and password file <none>
I20260808 02:43:20.724200 30736 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:20.724383 30736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:20.724789 30736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:20.728432 30736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "89cdf5df77984cf6867d4fa5ee71e3a2"
format_stamp: "Formatted at 2026-08-08 02:43:20 on dist-test-slave-8tdl"
server_key: "318381c4851ee9220d1d8c4da514c6bf"
server_key_iv: "d3aff24118295cdeeb0853023aa5cc0a"
server_key_version: "encryptionkey@0"
I20260808 02:43:20.729414 30736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "89cdf5df77984cf6867d4fa5ee71e3a2"
format_stamp: "Formatted at 2026-08-08 02:43:20 on dist-test-slave-8tdl"
server_key: "318381c4851ee9220d1d8c4da514c6bf"
server_key_iv: "d3aff24118295cdeeb0853023aa5cc0a"
server_key_version: "encryptionkey@0"
I20260808 02:43:20.736080 30736 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:43:20.740650 30751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:20.742542 30736 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:43:20.742842 30736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "89cdf5df77984cf6867d4fa5ee71e3a2"
format_stamp: "Formatted at 2026-08-08 02:43:20 on dist-test-slave-8tdl"
server_key: "318381c4851ee9220d1d8c4da514c6bf"
server_key_iv: "d3aff24118295cdeeb0853023aa5cc0a"
server_key_version: "encryptionkey@0"
I20260808 02:43:20.743063 30736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:20.769667 30736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:20.775157 30736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:20.775435 30736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:20.776507 30736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:20.778025 30736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:20.778108 30736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:20.778196 30736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:20.778241 30736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:20.816793 30736 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:34497
I20260808 02:43:20.816833 30871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:34497 every 8 connection(s)
I20260808 02:43:20.818238 30736 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:43:20.823693 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30736
I20260808 02:43:20.823941 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:43:20.824553 10321 external_mini_cluster.cc:1428] Setting key 1ba9abeeaf34c3082737a6678f3eec95
Aug 08 02:43:20 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157000, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.65@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:20.846642 30874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:20.821326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:41993 (local address 127.10.20.126:43855)
0808 02:43:20.821843 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:20.821848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:20.823304 (+ 1456us) server_negotiation.cc:407] Connection header received
0808 02:43:20.826098 (+ 2794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:20.826104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:20.826188 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:20.826333 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:20.828688 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:20.829509 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:20.832269 (+ 2760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:20.832969 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:20.833125 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:20.838279 (+ 5154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:20.838290 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:20.838298 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:20.838354 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:20.842223 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:20.843481 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:20.843491 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:20.843497 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:20.843686 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:20.844283 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:20.844289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:20.844293 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:20.844602 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:20.844790 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:20.846020 (+ 1230us) server_negotiation.cc:299] Negotiation successful
0808 02:43:20.846348 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":270,"threads_started":1}
I20260808 02:43:20.848215 30875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:20.821987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:43855 (local address 127.10.20.65:41993)
0808 02:43:20.823078 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:20.823122 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:20.825722 (+ 2600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:20.826550 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:20.826559 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:20.827496 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:20.828440 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:20.828479 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:20.829714 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:20.829723 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:20.832072 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:20.832096 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:20.833258 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:20.833268 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:20.833639 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:20.834517 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:20.834556 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:20.837905 (+ 3349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:20.842488 (+ 4583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:20.842503 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:20.842527 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:20.843304 (+ 777us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:20.843858 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:20.843868 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:20.843871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:20.844134 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:20.844764 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:20.844773 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:20.845310 (+ 537us) client_negotiation.cc:769] Sending connection context
0808 02:43:20.845715 (+ 405us) client_negotiation.cc:240] Negotiation successful
0808 02:43:20.846450 (+ 735us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":332,"threads_started":1}
I20260808 02:43:20.850358 30872 heartbeater.cc:347] Connected to a master server at 127.10.20.126:43855
I20260808 02:43:20.850790 30872 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:20.851912 30872 heartbeater.cc:511] Master 127.10.20.126:43855 requested a full tablet report, sending...
I20260808 02:43:20.854648 30670 ts_manager.cc:194] Registered new tserver with Master: 89cdf5df77984cf6867d4fa5ee71e3a2 (127.10.20.65:34497)
I20260808 02:43:20.856628 30670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.65@KRBTEST.COM'} at 127.10.20.65:41993
WARNING: no policy specified for kudu/127.10.20.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
Entry for principal kudu/127.10.20.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab.
I20260808 02:43:20.915055 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43855
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:21.300544 30878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:21.300859 30878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:21.301110 30878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:21.308917 30878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:21.309057 30878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:21.309180 30878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:43:21.319489 30878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.66.keytab
--principal=kudu/127.10.20.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:21.320812 30878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:21.322237 30878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:21.337639 30884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:21.337639 30883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:21.337659 30886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:21.338785 30878 server_base.cc:1034] running on GCE node
I20260808 02:43:21.339541 30878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:21.340656 30878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:21.341946 30878 hybrid_clock.cc:648] HybridClock initialized: now 1786157001341876 us; error 56 us; skew 500 ppm
I20260808 02:43:21.342458 30878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:21 dist-test-slave-8tdl krb5kdc[30622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157001, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:21.346141 30878 init.cc:377] Logged in from keytab as kudu/127.10.20.66@KRBTEST.COM (short username kudu)
I20260808 02:43:21.348425 30878 webserver.cc:460] Webserver started at http://127.10.20.66:37377/ using document root <none> and password file <none>
I20260808 02:43:21.349241 30878 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:21.349416 30878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:21.349784 30878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:21.353197 30878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a"
format_stamp: "Formatted at 2026-08-08 02:43:21 on dist-test-slave-8tdl"
server_key: "50e796fd4e9e022552f3d648f7879e5a"
server_key_iv: "2d38d2ca6ee4c6b43aaa8bd100f6beed"
server_key_version: "encryptionkey@0"
I20260808 02:43:21.354115 30878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a"
format_stamp: "Formatted at 2026-08-08 02:43:21 on dist-test-slave-8tdl"
server_key: "50e796fd4e9e022552f3d648f7879e5a"
server_key_iv: "2d38d2ca6ee4c6b43aaa8bd100f6beed"
server_key_version: "encryptionkey@0"
I20260808 02:43:21.360425 30878 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 02:43:21.364749 30893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:21.366513 30878 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 02:43:21.366784 30878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a"
format_stamp: "Formatted at 2026-08-08 02:43:21 on dist-test-slave-8tdl"
server_key: "50e796fd4e9e022552f3d648f7879e5a"
server_key_iv: "2d38d2ca6ee4c6b43aaa8bd100f6beed"
server_key_version: "encryptionkey@0"
I20260808 02:43:21.367048 30878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:21.388561 30878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:21.393908 30878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:21.394309 30878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:21.395656 30878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:21.397387 30878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:21.397527 30878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:21.397702 30878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:21.397785 30878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:21.439250 30878 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:46361
I20260808 02:43:21.439318 31012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:46361 every 8 connection(s)
I20260808 02:43:21.440665 30878 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:43:21.444861 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 30878
I20260808 02:43:21.445358 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:43:21.446101 10321 external_mini_cluster.cc:1428] Setting key 7acdbcd764b4280f78d9fc62ddadb470
Aug 08 02:43:21 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157001, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.66@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:21.464550 31015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:21.443960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:51161 (local address 127.10.20.126:43855)
0808 02:43:21.444546 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:21.444552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:21.445942 (+ 1390us) server_negotiation.cc:407] Connection header received
0808 02:43:21.448443 (+ 2501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:21.448448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:21.448606 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:21.448738 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:21.450464 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:21.451292 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:21.453023 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:21.453494 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:21.453649 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:21.457772 (+ 4123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:21.457778 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:21.457782 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:21.457826 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:21.460934 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:21.461895 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:21.461902 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:21.461905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:21.462050 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:21.462534 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:21.462539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:21.462542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:21.462933 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:21.463107 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:21.463892 (+ 785us) server_negotiation.cc:299] Negotiation successful
0808 02:43:21.464154 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":336,"threads_started":1}
I20260808 02:43:21.465700 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:21.444407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:43855 (local address 127.10.20.66:51161)
0808 02:43:21.445617 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:21.445669 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:21.448111 (+ 2442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:21.449028 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:21.449038 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:21.449652 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:21.450266 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:21.450285 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:21.451496 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:21.451500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:21.452848 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:21.452863 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:21.453763 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:21.453771 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:21.454030 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:21.454871 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:21.454902 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:21.457470 (+ 2568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:21.461146 (+ 3676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:21.461158 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:21.461187 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:21.461707 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:21.462179 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:21.462184 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:21.462188 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:21.462410 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:21.463077 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:21.463086 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:21.463493 (+ 407us) client_negotiation.cc:769] Sending connection context
0808 02:43:21.463799 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 02:43:21.464409 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"thread_start_us":647,"threads_started":1}
I20260808 02:43:21.467685 31013 heartbeater.cc:347] Connected to a master server at 127.10.20.126:43855
I20260808 02:43:21.468026 31013 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:21.468847 31013 heartbeater.cc:511] Master 127.10.20.126:43855 requested a full tablet report, sending...
I20260808 02:43:21.470661 30670 ts_manager.cc:194] Registered new tserver with Master: 74c8fd05e7a84e9085ebda7abf8c0b1a (127.10.20.66:46361)
I20260808 02:43:21.472265 30670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.66@KRBTEST.COM'} at 127.10.20.66:51161
WARNING: no policy specified for kudu/127.10.20.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
Entry for principal kudu/127.10.20.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab.
I20260808 02:43:21.535115 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43855
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:33617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:43:21.861431 30872 heartbeater.cc:503] Master 127.10.20.126:43855 was elected leader, sending a full tablet report...
W20260808 02:43:21.920029 31019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:21.920365 31019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:21.920537 31019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:21.928407 31019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:21.928548 31019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:21.928747 31019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:43:21.939512 31019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:33617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.67.keytab
--principal=kudu/127.10.20.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:43855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:21.941061 31019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:21.942636 31019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:21.959122 31025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:21.959110 31026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:21.959153 31028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:21.959954 31019 server_base.cc:1034] running on GCE node
I20260808 02:43:21.960623 31019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:21.961768 31019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:21.963120 31019 hybrid_clock.cc:648] HybridClock initialized: now 1786157001963027 us; error 76 us; skew 500 ppm
I20260808 02:43:21.963752 31019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:21 dist-test-slave-8tdl krb5kdc[30622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157001, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:21.968537 31019 init.cc:377] Logged in from keytab as kudu/127.10.20.67@KRBTEST.COM (short username kudu)
I20260808 02:43:21.971047 31019 webserver.cc:460] Webserver started at http://127.10.20.67:37893/ using document root <none> and password file <none>
I20260808 02:43:21.972162 31019 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:21.972357 31019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:21.972725 31019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:21.976569 31019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19"
format_stamp: "Formatted at 2026-08-08 02:43:21 on dist-test-slave-8tdl"
server_key: "b9a315f334a84faa5704d3ad7de99303"
server_key_iv: "131350025404539b54cca82decd9a707"
server_key_version: "encryptionkey@0"
I20260808 02:43:21.977622 31019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19"
format_stamp: "Formatted at 2026-08-08 02:43:21 on dist-test-slave-8tdl"
server_key: "b9a315f334a84faa5704d3ad7de99303"
server_key_iv: "131350025404539b54cca82decd9a707"
server_key_version: "encryptionkey@0"
I20260808 02:43:21.983930 31019 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:43:21.988448 31035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:21.990087 31019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 02:43:21.990316 31019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19"
format_stamp: "Formatted at 2026-08-08 02:43:21 on dist-test-slave-8tdl"
server_key: "b9a315f334a84faa5704d3ad7de99303"
server_key_iv: "131350025404539b54cca82decd9a707"
server_key_version: "encryptionkey@0"
I20260808 02:43:21.990578 31019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:22.016425 31019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:22.021534 31019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:22.021889 31019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:22.023125 31019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:22.024704 31019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:22.024827 31019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:22.025004 31019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:22.025081 31019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:22.064185 31019 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:33227
I20260808 02:43:22.064251 31155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:33227 every 8 connection(s)
I20260808 02:43:22.065702 31019 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:43:22.066135 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31019
I20260808 02:43:22.066401 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:43:22.067243 10321 external_mini_cluster.cc:1428] Setting key 93893fd91e8265807d2ef98757c3b929
Aug 08 02:43:22 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157001, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.67@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:22.100564 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.068794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:48577 (local address 127.10.20.126:43855)
0808 02:43:22.075199 (+ 6405us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.075204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.075223 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:43:22.075285 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.075288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.075368 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.075483 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:22.077678 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.078840 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.080730 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.081207 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.081341 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.092418 (+ 11077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:22.092425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:22.092429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:22.092474 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:22.096379 (+ 3905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.097487 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.097495 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.097499 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.097661 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.098273 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.098278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.098281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.098652 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:22.098892 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.099946 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.100202 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6279,"thread_start_us":6103,"threads_started":1}
I20260808 02:43:22.101899 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.069519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:43855 (local address 127.10.20.67:48577)
0808 02:43:22.070551 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:22.070604 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:22.072782 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:22.075948 (+ 3166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:22.075959 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:22.076613 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:22.077419 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.077444 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.079139 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.079144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.080524 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.080540 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.081491 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.081497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.081781 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.088337 (+ 6556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:43:22.088377 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:22.092007 (+ 3630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:22.096568 (+ 4561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:22.096580 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:22.096602 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:22.097326 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:22.097786 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:43:22.097792 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:43:22.097796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:43:22.098086 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:43:22.098900 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:22.098909 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:22.099400 (+ 491us) client_negotiation.cc:769] Sending connection context
0808 02:43:22.099793 (+ 393us) client_negotiation.cc:240] Negotiation successful
0808 02:43:22.100434 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":431,"threads_started":1}
I20260808 02:43:22.103770 31156 heartbeater.cc:347] Connected to a master server at 127.10.20.126:43855
I20260808 02:43:22.104322 31156 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:22.105175 31156 heartbeater.cc:511] Master 127.10.20.126:43855 requested a full tablet report, sending...
I20260808 02:43:22.107124 30670 ts_manager.cc:194] Registered new tserver with Master: 13f4dc5ed1f1415fbad92a7b1ad5ca19 (127.10.20.67:33227)
I20260808 02:43:22.108026 30670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.20.67@KRBTEST.COM'} at 127.10.20.67:48577
I20260808 02:43:22.110898 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:43:22.131436 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.115705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41418 (local address 127.10.20.126:43855)
0808 02:43:22.115978 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.115985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.116414 (+ 429us) server_negotiation.cc:407] Connection header received
0808 02:43:22.116648 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.116652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.116724 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.116843 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:22.118435 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.119285 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.120683 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.121108 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.121249 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.124174 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:22.124180 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:22.124184 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:22.124228 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:22.127388 (+ 3160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.128273 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.128278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.128281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.128437 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.129262 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.129267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.129269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.129665 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:22.129898 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.130548 (+ 650us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.131029 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 02:43:22.136581 30670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:43:22.146104 30670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:43:22.175138 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.162622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:46361 (local address 127.0.0.1:35798)
0808 02:43:22.164158 (+ 1536us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:22.164208 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:22.164456 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:22.165509 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:22.165555 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:22.165639 (+ 84us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:22.166403 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.166425 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.169129 (+ 2704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.169136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.172055 (+ 2919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.172073 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.173950 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.173956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.174228 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.174283 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 02:43:22.174463 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 02:43:22.174721 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1247,"thread_start_us":1001,"threads_started":1}
I20260808 02:43:22.175125 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.162877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35798 (local address 127.10.20.66:46361)
0808 02:43:22.163622 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.163633 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.164342 (+ 709us) server_negotiation.cc:407] Connection header received
0808 02:43:22.164730 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.164741 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.165073 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.165994 (+ 921us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:22.166756 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.168894 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.172324 (+ 3430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.173706 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.173880 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.174136 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.174511 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.174728 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":403,"threads_started":1}
I20260808 02:43:22.177611 31174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.164537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:33227 (local address 127.0.0.1:47626)
0808 02:43:22.165183 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:22.165205 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:22.165542 (+ 337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:22.169600 (+ 4058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:22.169605 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:22.169637 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:22.170184 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.170196 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.172114 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.172119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.174439 (+ 2320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.174455 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.176533 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.176539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.176738 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.176776 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 02:43:22.176849 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 02:43:22.177243 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":324,"threads_started":1}
I20260808 02:43:22.178601 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.164971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.10.20.67:33227)
0808 02:43:22.168965 (+ 3994us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.168976 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.169017 (+ 41us) server_negotiation.cc:407] Connection header received
0808 02:43:22.169123 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.169132 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.169379 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.169617 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:22.170473 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.171942 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.174638 (+ 2696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.176302 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.177900 (+ 1598us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.178122 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.178184 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.178317 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3785,"thread_start_us":3600,"threads_started":1}
I20260808 02:43:22.180246 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.165419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:34497 (local address 127.0.0.1:45092)
0808 02:43:22.167984 (+ 2565us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:22.168006 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:22.168155 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:22.170155 (+ 2000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:22.170164 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:22.170194 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:22.170659 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.170697 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.173215 (+ 2518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.173221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.175438 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.175456 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.179419 (+ 3963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.179429 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.179610 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.179647 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:43:22.179741 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 02:43:22.179889 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2430,"thread_start_us":2257,"threads_started":1}
I20260808 02:43:22.180402 31176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.165456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45092 (local address 127.10.20.65:34497)
0808 02:43:22.169274 (+ 3818us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.169285 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.169316 (+ 31us) server_negotiation.cc:407] Connection header received
0808 02:43:22.169623 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.169632 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.169867 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.170133 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:22.170887 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.173051 (+ 2164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.175646 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.179135 (+ 3489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.179306 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.179548 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.179868 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.180067 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3609,"thread_start_us":3445,"threads_started":1}
I20260808 02:43:22.180174 30944 tablet_service.cc:1467] Processing CreateTablet for tablet 53d8d853839b41dc857385a6a0eb191c (DEFAULT_TABLE table=test-table [id=5a567b32e0554e33840101db0d09f547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:22.181895 30944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53d8d853839b41dc857385a6a0eb191c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:22.182600 31085 tablet_service.cc:1467] Processing CreateTablet for tablet 53d8d853839b41dc857385a6a0eb191c (DEFAULT_TABLE table=test-table [id=5a567b32e0554e33840101db0d09f547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:22.184922 31085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53d8d853839b41dc857385a6a0eb191c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:22.185388 30802 tablet_service.cc:1467] Processing CreateTablet for tablet 53d8d853839b41dc857385a6a0eb191c (DEFAULT_TABLE table=test-table [id=5a567b32e0554e33840101db0d09f547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:22.187152 30802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53d8d853839b41dc857385a6a0eb191c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:22.193883 31178 tablet_bootstrap.cc:492] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Bootstrap starting.
I20260808 02:43:22.198515 31178 tablet_bootstrap.cc:654] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:22.199800 31178 log.cc:824] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:22.202396 31180 tablet_bootstrap.cc:492] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Bootstrap starting.
I20260808 02:43:22.203711 31178 tablet_bootstrap.cc:492] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: No bootstrap required, opened a new log
I20260808 02:43:22.204070 31178 ts_tablet_manager.cc:1397] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 02:43:22.206399 31181 tablet_bootstrap.cc:492] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Bootstrap starting.
I20260808 02:43:22.207144 31180 tablet_bootstrap.cc:654] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:22.208695 31180 log.cc:824] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:22.210071 31181 tablet_bootstrap.cc:654] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:22.211336 31181 log.cc:824] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:22.212882 31180 tablet_bootstrap.cc:492] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: No bootstrap required, opened a new log
I20260808 02:43:22.213246 31180 ts_tablet_manager.cc:1397] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 02:43:22.214896 31181 tablet_bootstrap.cc:492] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: No bootstrap required, opened a new log
I20260808 02:43:22.215227 31181 ts_tablet_manager.cc:1397] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 02:43:22.219457 31178 raft_consensus.cc:348] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.220084 31178 raft_consensus.cc:374] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:22.220202 31178 raft_consensus.cc:729] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74c8fd05e7a84e9085ebda7abf8c0b1a, State: Initialized, Role: FOLLOWER
I20260808 02:43:22.221012 31178 consensus_queue.cc:260] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.222430 31013 heartbeater.cc:503] Master 127.10.20.126:43855 was elected leader, sending a full tablet report...
I20260808 02:43:22.223392 31178 ts_tablet_manager.cc:1428] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Time spent starting tablet: real 0.019s user 0.017s sys 0.001s
I20260808 02:43:22.224272 31181 raft_consensus.cc:348] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.224812 31181 raft_consensus.cc:374] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:22.224921 31181 raft_consensus.cc:729] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89cdf5df77984cf6867d4fa5ee71e3a2, State: Initialized, Role: FOLLOWER
I20260808 02:43:22.225648 31181 consensus_queue.cc:260] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.226765 31180 raft_consensus.cc:348] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.227424 31180 raft_consensus.cc:374] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:22.227558 31180 raft_consensus.cc:729] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f4dc5ed1f1415fbad92a7b1ad5ca19, State: Initialized, Role: FOLLOWER
I20260808 02:43:22.228400 31180 consensus_queue.cc:260] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.231099 31181 ts_tablet_manager.cc:1428] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260808 02:43:22.231527 31156 heartbeater.cc:503] Master 127.10.20.126:43855 was elected leader, sending a full tablet report...
I20260808 02:43:22.232334 31180 ts_tablet_manager.cc:1428] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Time spent starting tablet: real 0.019s user 0.015s sys 0.004s
W20260808 02:43:22.317909 31157 tablet.cc:2369] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:43:22.321523 30873 tablet.cc:2369] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:22.423866 31185 raft_consensus.cc:482] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:43:22.424299 31185 raft_consensus.cc:504] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.426165 31185 leader_election.cc:288] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74c8fd05e7a84e9085ebda7abf8c0b1a (127.10.20.66:46361), 13f4dc5ed1f1415fbad92a7b1ad5ca19 (127.10.20.67:33227)
I20260808 02:43:22.436065 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.427987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:54989 (local address 127.10.20.67:33227)
0808 02:43:22.428230 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.428238 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.428861 (+ 623us) server_negotiation.cc:407] Connection header received
0808 02:43:22.429108 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.429115 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.429200 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.429316 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:22.429864 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.430828 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.433244 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.434646 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.434851 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.434916 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.435624 (+ 708us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.435776 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:43:22.436146 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.426789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:42009 (local address 127.10.20.66:46361)
0808 02:43:22.427042 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.427053 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.427828 (+ 775us) server_negotiation.cc:407] Connection header received
0808 02:43:22.428053 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.428063 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.428184 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.428311 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:22.429144 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.430262 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.433105 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.434546 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.434822 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.434912 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.435624 (+ 712us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.435776 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 02:43:22.436386 31187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.426768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:46361 (local address 127.10.20.65:42009)
0808 02:43:22.427614 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:22.427636 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:22.427862 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:22.428481 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:22.428486 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:22.428515 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:22.428969 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.428992 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.430440 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.430444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.432860 (+ 2416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.432881 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.435065 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.435081 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.435345 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.435444 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 02:43:22.435565 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 02:43:22.435771 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":102,"thread_start_us":519,"threads_started":1}
I20260808 02:43:22.436434 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.427828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:33227 (local address 127.10.20.65:54989)
0808 02:43:22.428705 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:22.428730 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:22.428871 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:22.429335 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:22.429338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:22.429358 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:22.429644 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.429650 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.430980 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.430986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.433051 (+ 2065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:22.433065 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.435065 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.435079 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:22.435440 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.435465 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 02:43:22.435565 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 02:43:22.435771 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":114,"thread_start_us":396,"threads_started":1}
I20260808 02:43:22.437703 31108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d8d853839b41dc857385a6a0eb191c" candidate_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" is_pre_election: true
I20260808 02:43:22.437701 30966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d8d853839b41dc857385a6a0eb191c" candidate_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" is_pre_election: true
I20260808 02:43:22.438273 30966 raft_consensus.cc:2454] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89cdf5df77984cf6867d4fa5ee71e3a2 in term 0.
I20260808 02:43:22.438295 31108 raft_consensus.cc:2454] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89cdf5df77984cf6867d4fa5ee71e3a2 in term 0.
I20260808 02:43:22.439213 30752 leader_election.cc:302] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f4dc5ed1f1415fbad92a7b1ad5ca19, 89cdf5df77984cf6867d4fa5ee71e3a2; no voters:
I20260808 02:43:22.439704 31185 raft_consensus.cc:2781] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:43:22.439865 31185 raft_consensus.cc:482] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:43:22.439976 31185 raft_consensus.cc:3037] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 0 FOLLOWER]: Advancing to term 1
W20260808 02:43:22.443368 31014 tablet.cc:2369] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:22.443356 31185 raft_consensus.cc:504] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.444240 31185 leader_election.cc:288] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [CANDIDATE]: Term 1 election: Requested vote from peers 74c8fd05e7a84e9085ebda7abf8c0b1a (127.10.20.66:46361), 13f4dc5ed1f1415fbad92a7b1ad5ca19 (127.10.20.67:33227)
I20260808 02:43:22.444917 30966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d8d853839b41dc857385a6a0eb191c" candidate_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a"
I20260808 02:43:22.445182 30966 raft_consensus.cc:3037] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:22.445416 31108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d8d853839b41dc857385a6a0eb191c" candidate_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19"
I20260808 02:43:22.445677 31108 raft_consensus.cc:3037] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:22.449079 30966 raft_consensus.cc:2454] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89cdf5df77984cf6867d4fa5ee71e3a2 in term 1.
I20260808 02:43:22.449191 31108 raft_consensus.cc:2454] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89cdf5df77984cf6867d4fa5ee71e3a2 in term 1.
I20260808 02:43:22.449777 30752 leader_election.cc:302] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f4dc5ed1f1415fbad92a7b1ad5ca19, 89cdf5df77984cf6867d4fa5ee71e3a2; no voters:
I20260808 02:43:22.450311 31185 raft_consensus.cc:2781] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:22.450887 31185 raft_consensus.cc:686] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 1 LEADER]: Becoming Leader. State: Replica: 89cdf5df77984cf6867d4fa5ee71e3a2, State: Running, Role: LEADER
I20260808 02:43:22.451486 31185 consensus_queue.cc:237] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } }
I20260808 02:43:22.456681 30668 catalog_manager.cc:5495] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89cdf5df77984cf6867d4fa5ee71e3a2 (127.10.20.65). New cstate: current_term: 1 leader_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89cdf5df77984cf6867d4fa5ee71e3a2" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 34497 } health_report { overall_health: HEALTHY } } }
I20260808 02:43:22.490274 31176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.483676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45102 (local address 127.10.20.65:34497)
0808 02:43:22.483911 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.483916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.484051 (+ 135us) server_negotiation.cc:407] Connection header received
0808 02:43:22.484316 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.484321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.484410 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.484560 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:43:22.484957 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.485976 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.487585 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.488146 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.488271 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.488944 (+ 673us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:43:22.489567 (+ 623us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:43:22.489701 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.489883 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.490027 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:43:22.500205 31108 raft_consensus.cc:1261] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 1 FOLLOWER]: Refusing update from remote peer 89cdf5df77984cf6867d4fa5ee71e3a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:22.500202 30966 raft_consensus.cc:1261] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 1 FOLLOWER]: Refusing update from remote peer 89cdf5df77984cf6867d4fa5ee71e3a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:22.501410 31185 consensus_queue.cc:1035] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74c8fd05e7a84e9085ebda7abf8c0b1a" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:22.501768 31189 consensus_queue.cc:1035] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f4dc5ed1f1415fbad92a7b1ad5ca19" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:22.536545 30670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:22.536906 30670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:22.541401 30670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd2bb2b333234c00bcb8b2399a146a34: Sending DeleteTablet for 3 replicas of tablet 53d8d853839b41dc857385a6a0eb191c
I20260808 02:43:22.543349 30944 tablet_service.cc:1514] Processing DeleteTablet for tablet 53d8d853839b41dc857385a6a0eb191c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:22 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:35798
I20260808 02:43:22.543324 31085 tablet_service.cc:1514] Processing DeleteTablet for tablet 53d8d853839b41dc857385a6a0eb191c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:22 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:47626
I20260808 02:43:22.544485 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30736
I20260808 02:43:22.544507 30802 tablet_service.cc:1514] Processing DeleteTablet for tablet 53d8d853839b41dc857385a6a0eb191c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:22 UTC) from {username='kudu', principal='kudu/127.10.20.126@KRBTEST.COM'} at 127.0.0.1:45092
I20260808 02:43:22.558316 31204 tablet_replica.cc:330] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: stopping tablet replica
I20260808 02:43:22.559221 31204 raft_consensus.cc:2229] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:43:22.559556 31202 tablet_replica.cc:330] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: stopping tablet replica
I20260808 02:43:22.560179 31202 raft_consensus.cc:2229] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:22.560326 31204 raft_consensus.cc:2258] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:22.560871 31202 raft_consensus.cc:2258] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:22.563140 31202 ts_tablet_manager.cc:1905] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:22.563150 31204 ts_tablet_manager.cc:1905] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:22.565412 31203 tablet_replica.cc:330] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: stopping tablet replica
I20260808 02:43:22.566211 31203 raft_consensus.cc:2229] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:22.571167 31203 raft_consensus.cc:2258] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:22.572117 31202 ts_tablet_manager.cc:1918] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:22.572435 31202 log.cc:1196] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/53d8d853839b41dc857385a6a0eb191c
I20260808 02:43:22.572450 31204 ts_tablet_manager.cc:1918] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:22.572654 31204 log.cc:1196] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/53d8d853839b41dc857385a6a0eb191c
I20260808 02:43:22.573310 31202 ts_tablet_manager.cc:1939] T 53d8d853839b41dc857385a6a0eb191c P 13f4dc5ed1f1415fbad92a7b1ad5ca19: Deleting consensus metadata
I20260808 02:43:22.573310 31204 ts_tablet_manager.cc:1939] T 53d8d853839b41dc857385a6a0eb191c P 89cdf5df77984cf6867d4fa5ee71e3a2: Deleting consensus metadata
I20260808 02:43:22.575527 30653 catalog_manager.cc:4841] TS 89cdf5df77984cf6867d4fa5ee71e3a2 (127.10.20.65:34497): tablet 53d8d853839b41dc857385a6a0eb191c (table test-table [id=5a567b32e0554e33840101db0d09f547]) successfully deleted
I20260808 02:43:22.575639 31203 ts_tablet_manager.cc:1905] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:22.575913 30653 catalog_manager.cc:4841] TS 13f4dc5ed1f1415fbad92a7b1ad5ca19 (127.10.20.67:33227): tablet 53d8d853839b41dc857385a6a0eb191c (table test-table [id=5a567b32e0554e33840101db0d09f547]) successfully deleted
Aug 08 02:43:22 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.65@KRBTEST.COM
I20260808 02:43:22.583979 31203 ts_tablet_manager.cc:1918] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:22.584193 31203 log.cc:1196] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/53d8d853839b41dc857385a6a0eb191c
I20260808 02:43:22.584839 31203 ts_tablet_manager.cc:1939] T 53d8d853839b41dc857385a6a0eb191c P 74c8fd05e7a84e9085ebda7abf8c0b1a: Deleting consensus metadata
I20260808 02:43:22.587111 30653 catalog_manager.cc:4841] TS 74c8fd05e7a84e9085ebda7abf8c0b1a (127.10.20.66:46361): tablet 53d8d853839b41dc857385a6a0eb191c (table test-table [id=5a567b32e0554e33840101db0d09f547]) successfully deleted
I20260808 02:43:22.591120 31176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.546305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45114 (local address 127.10.20.65:34497)
0808 02:43:22.546528 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.546535 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.556943 (+ 10408us) server_negotiation.cc:407] Connection header received
0808 02:43:22.557232 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.557239 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.557368 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.557512 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:22.566552 (+ 9040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.568070 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.571905 (+ 3835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.572828 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.572998 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.583727 (+ 10729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:22.583747 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:22.583764 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:22.583814 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:22.587698 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.588601 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.588611 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.588614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.588790 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.589259 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.589264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.589266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.589679 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:22.590033 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.590414 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.590735 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:43:22.591917 30866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:22.699317 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30736
I20260808 02:43:22.722268 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30878
Aug 08 02:43:22 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.66@KRBTEST.COM
I20260808 02:43:22.740404 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.723196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35802 (local address 127.10.20.66:46361)
0808 02:43:22.723415 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.723422 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.723447 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:43:22.723571 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.723578 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.723668 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.723800 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:22.725572 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.726321 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.727826 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.728251 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.728398 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.733164 (+ 4766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:22.733182 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:22.733198 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:22.733247 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:22.736773 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.737838 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.737848 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.737850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.738012 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.738459 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.738465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.738469 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.739010 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:22.739371 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.739733 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.740006 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 02:43:22.741117 31008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:22.835496 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30878
I20260808 02:43:22.855895 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31019
Aug 08 02:43:22 dist-test-slave-8tdl krb5kdc[30622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786156999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.67@KRBTEST.COM
I20260808 02:43:22.873565 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:22.856771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47636 (local address 127.10.20.67:33227)
0808 02:43:22.856969 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:22.856975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:22.857000 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:43:22.857133 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:22.857137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:22.857204 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:22.857291 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:22.858955 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.859747 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.861194 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:22.861598 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:22.861699 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:22.866932 (+ 5233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:22.866953 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:22.866970 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:22.867024 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:22.870263 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.871230 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.871238 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.871241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.871409 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:22.871815 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:22.871821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:22.871824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:22.872236 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:22.872562 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:22.872913 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 02:43:22.873168 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:43:22.874254 31150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:22.968403 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31019
I20260808 02:43:22.988909 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 30637
I20260808 02:43:22.990198 30702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:23.108702 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 30637
2026-08-08T02:43:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5127 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T02:43:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:23Z Disabled control of system clock
I20260808 02:43:23.223301 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:33801
--webserver_interface=127.10.20.126
--webserver_port=0
--builtin_ntp_servers=127.10.20.84:45907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:33801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:43:23.603788 31213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:23.604132 31213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:23.604219 31213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:23.611920 31213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:23.612066 31213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:23.612105 31213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:23.612176 31213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:23.612221 31213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:23.622186 31213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:33801
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:33801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:23.623703 31213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:23.625628 31213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:23.639950 31222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:23.640126 31219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:23.640101 31220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:23.640915 31213 server_base.cc:1034] running on GCE node
I20260808 02:43:23.641920 31213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:23.643723 31213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:23.645004 31213 hybrid_clock.cc:648] HybridClock initialized: now 1786157003644928 us; error 86 us; skew 500 ppm
I20260808 02:43:23.645463 31213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:23.648244 31213 webserver.cc:460] Webserver started at http://127.10.20.126:46299/ using document root <none> and password file <none>
I20260808 02:43:23.649290 31213 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:23.649487 31213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:23.649865 31213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:23.653301 31213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "794ccc501f2c46dab5c70776a60fd57c"
format_stamp: "Formatted at 2026-08-08 02:43:23 on dist-test-slave-8tdl"
server_key: "c67c30ec35f07e3c0ed7a9538b338771"
server_key_iv: "0154a5ec1ae155476ecf9deb8581b5be"
server_key_version: "encryptionkey@0"
I20260808 02:43:23.654472 31213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "794ccc501f2c46dab5c70776a60fd57c"
format_stamp: "Formatted at 2026-08-08 02:43:23 on dist-test-slave-8tdl"
server_key: "c67c30ec35f07e3c0ed7a9538b338771"
server_key_iv: "0154a5ec1ae155476ecf9deb8581b5be"
server_key_version: "encryptionkey@0"
I20260808 02:43:23.661159 31213 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:43:23.665582 31228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:23.667479 31213 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:23.667745 31213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "794ccc501f2c46dab5c70776a60fd57c"
format_stamp: "Formatted at 2026-08-08 02:43:23 on dist-test-slave-8tdl"
server_key: "c67c30ec35f07e3c0ed7a9538b338771"
server_key_iv: "0154a5ec1ae155476ecf9deb8581b5be"
server_key_version: "encryptionkey@0"
I20260808 02:43:23.668013 31213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:23.686124 31213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:23.687211 31213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:23.687597 31213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:23.709923 31213 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:33801
I20260808 02:43:23.709945 31284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:33801 every 8 connection(s)
I20260808 02:43:23.711603 31213 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:23.716365 31285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:23.722111 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31213
I20260808 02:43:23.722326 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:23.723022 10321 external_mini_cluster.cc:1428] Setting key ec561ac61fda541624fd8379a119ad5b
I20260808 02:43:23.735527 31285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c: Bootstrap starting.
I20260808 02:43:23.740008 31285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:23.741533 31285 log.cc:824] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:23.742653 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:23.726432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57198 (local address 127.10.20.126:33801)
0808 02:43:23.727862 (+ 1430us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:23.727880 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:23.727942 (+ 62us) server_negotiation.cc:407] Connection header received
0808 02:43:23.730238 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:23.730289 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:23.731139 (+ 850us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:23.731689 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:23.732358 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:23.734417 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:23.736525 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:23.737724 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:23.737960 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:23.739393 (+ 1433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:23.739405 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:23.739424 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:23.740276 (+ 852us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:23.740431 (+ 155us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:23.740471 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:23.740629 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:23.740899 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 02:43:23.741276 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":834,"thread_start_us":547,"threads_started":1}
I20260808 02:43:23.745397 31285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c: No bootstrap required, opened a new log
I20260808 02:43:23.753950 31285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794ccc501f2c46dab5c70776a60fd57c" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33801 } }
I20260808 02:43:23.754387 31285 raft_consensus.cc:374] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:23.754537 31285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794ccc501f2c46dab5c70776a60fd57c, State: Initialized, Role: FOLLOWER
I20260808 02:43:23.755239 31285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794ccc501f2c46dab5c70776a60fd57c" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33801 } }
I20260808 02:43:23.755507 31285 raft_consensus.cc:388] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:23.755666 31285 raft_consensus.cc:482] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:23.755851 31285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:23.758430 31285 raft_consensus.cc:504] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794ccc501f2c46dab5c70776a60fd57c" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33801 } }
I20260808 02:43:23.759137 31285 leader_election.cc:302] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 794ccc501f2c46dab5c70776a60fd57c; no voters:
I20260808 02:43:23.759790 31285 leader_election.cc:288] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:23.760229 31290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:23.761261 31290 raft_consensus.cc:686] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [term 1 LEADER]: Becoming Leader. State: Replica: 794ccc501f2c46dab5c70776a60fd57c, State: Running, Role: LEADER
I20260808 02:43:23.762120 31285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:23.762022 31290 consensus_queue.cc:237] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794ccc501f2c46dab5c70776a60fd57c" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33801 } }
I20260808 02:43:23.765479 31292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 794ccc501f2c46dab5c70776a60fd57c. Latest consensus state: current_term: 1 leader_uuid: "794ccc501f2c46dab5c70776a60fd57c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794ccc501f2c46dab5c70776a60fd57c" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33801 } } }
I20260808 02:43:23.766398 31292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:23.765925 31291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "794ccc501f2c46dab5c70776a60fd57c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794ccc501f2c46dab5c70776a60fd57c" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33801 } } }
I20260808 02:43:23.767004 31291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:23.771564 31300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:23.777153 31300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:23.788023 31300 catalog_manager.cc:1347] Generated new cluster ID: 5655a883675942ac987609019d5fcddf
I20260808 02:43:23.788173 31300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:23.807037 31300 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:23.808458 31300 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:23.818224 31300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c: Generated new TSK 0
I20260808 02:43:23.819422 31300 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:23.833511 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.65:0
--local_ip_for_outbound_sockets=127.10.20.65
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33801
--builtin_ntp_servers=127.10.20.84:45907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 02:43:24.227761 31310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:24.228103 31310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:24.228259 31310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:24.236498 31310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:24.236634 31310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:24.236806 31310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.65
I20260808 02:43:24.247694 31310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.20.65
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.65
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:24.249159 31310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:24.251257 31310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:24.266714 31319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:24.266844 31315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:24.266848 31316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:24.268239 31310 server_base.cc:1034] running on GCE node
I20260808 02:43:24.268977 31310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:24.270274 31310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:24.271507 31310 hybrid_clock.cc:648] HybridClock initialized: now 1786157004271424 us; error 77 us; skew 500 ppm
I20260808 02:43:24.271941 31310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:24.275002 31310 webserver.cc:460] Webserver started at http://127.10.20.65:34267/ using document root <none> and password file <none>
I20260808 02:43:24.275851 31310 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:24.275959 31310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:24.276378 31310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:24.279953 31310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data/instance:
uuid: "0e072f84b50347409ad0e2ae54a4e4db"
format_stamp: "Formatted at 2026-08-08 02:43:24 on dist-test-slave-8tdl"
server_key: "ee420bc45879c331374c4b3aa5ed698c"
server_key_iv: "3b249b5b77ec696953d7949efe0c8a1e"
server_key_version: "encryptionkey@0"
I20260808 02:43:24.280915 31310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance:
uuid: "0e072f84b50347409ad0e2ae54a4e4db"
format_stamp: "Formatted at 2026-08-08 02:43:24 on dist-test-slave-8tdl"
server_key: "ee420bc45879c331374c4b3aa5ed698c"
server_key_iv: "3b249b5b77ec696953d7949efe0c8a1e"
server_key_version: "encryptionkey@0"
I20260808 02:43:24.287514 31310 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 02:43:24.292037 31325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:24.293848 31310 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:43:24.294092 31310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal
uuid: "0e072f84b50347409ad0e2ae54a4e4db"
format_stamp: "Formatted at 2026-08-08 02:43:24 on dist-test-slave-8tdl"
server_key: "ee420bc45879c331374c4b3aa5ed698c"
server_key_iv: "3b249b5b77ec696953d7949efe0c8a1e"
server_key_version: "encryptionkey@0"
I20260808 02:43:24.294342 31310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:24.335541 31310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:24.336529 31310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:24.336889 31310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:24.338017 31310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:24.339931 31310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:24.340031 31310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:24.340209 31310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:24.340301 31310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:24.378882 31310 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.65:37945
I20260808 02:43:24.378986 31445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.65:37945 every 8 connection(s)
I20260808 02:43:24.380330 31310 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/data/info.pb
I20260808 02:43:24.389114 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31310
I20260808 02:43:24.389320 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal/instance
I20260808 02:43:24.389902 10321 external_mini_cluster.cc:1428] Setting key c46821ee7253e91b1d6661108fc743a6
I20260808 02:43:24.393280 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.66:0
--local_ip_for_outbound_sockets=127.10.20.66
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33801
--builtin_ntp_servers=127.10.20.84:45907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:43:24.396917 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:24.383570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.65:43349 (local address 127.10.20.126:33801)
0808 02:43:24.384186 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:24.384190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:24.385437 (+ 1247us) server_negotiation.cc:407] Connection header received
0808 02:43:24.387869 (+ 2432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:24.387876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:24.387983 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:24.388150 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:24.390225 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.391255 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.393489 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.393948 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.394110 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:24.395877 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:24.395883 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:24.395886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:24.395910 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:24.395995 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:24.396011 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:24.396128 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:24.396387 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 02:43:24.396513 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":308,"threads_started":1}
I20260808 02:43:24.398136 31449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:24.384100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:33801 (local address 127.10.20.65:43349)
0808 02:43:24.385235 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:24.385288 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:24.387498 (+ 2210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:24.388706 (+ 1208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:24.388722 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:24.388904 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:24.389905 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:24.389938 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.391502 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.391508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:24.393278 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:24.393296 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.394233 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.394241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:24.394508 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:24.395448 (+ 940us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:24.395451 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:24.395502 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:24.395606 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:24.396131 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:24.396147 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:24.396157 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 02:43:24.396373 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 02:43:24.396872 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":381,"threads_started":1}
I20260808 02:43:24.400404 31446 heartbeater.cc:347] Connected to a master server at 127.10.20.126:33801
I20260808 02:43:24.400802 31446 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:24.401695 31446 heartbeater.cc:511] Master 127.10.20.126:33801 requested a full tablet report, sending...
I20260808 02:43:24.404424 31248 ts_manager.cc:194] Registered new tserver with Master: 0e072f84b50347409ad0e2ae54a4e4db (127.10.20.65:37945)
I20260808 02:43:24.406751 31248 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.65:43349
W20260808 02:43:24.777235 31450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:24.777555 31450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:24.777645 31450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:24.786134 31450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:24.786283 31450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:24.786412 31450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.66
I20260808 02:43:24.796731 31450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.20.66
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.66
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:24.798099 31450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:24.800279 31450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:24.815110 31458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:24.815286 31456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:24.815958 31455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:24.816622 31450 server_base.cc:1034] running on GCE node
I20260808 02:43:24.817405 31450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:24.818746 31450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:24.820019 31450 hybrid_clock.cc:648] HybridClock initialized: now 1786157004819957 us; error 95 us; skew 500 ppm
I20260808 02:43:24.820441 31450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:24.823297 31450 webserver.cc:460] Webserver started at http://127.10.20.66:35369/ using document root <none> and password file <none>
I20260808 02:43:24.824087 31450 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:24.824210 31450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:24.824590 31450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:24.827924 31450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data/instance:
uuid: "d52c5ca8ad874c19af393b98bcd013c0"
format_stamp: "Formatted at 2026-08-08 02:43:24 on dist-test-slave-8tdl"
server_key: "617031cf00f07e24e82684738e8594ff"
server_key_iv: "572a85e642d2c974b661b0c2fcb16b18"
server_key_version: "encryptionkey@0"
I20260808 02:43:24.828868 31450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance:
uuid: "d52c5ca8ad874c19af393b98bcd013c0"
format_stamp: "Formatted at 2026-08-08 02:43:24 on dist-test-slave-8tdl"
server_key: "617031cf00f07e24e82684738e8594ff"
server_key_iv: "572a85e642d2c974b661b0c2fcb16b18"
server_key_version: "encryptionkey@0"
I20260808 02:43:24.834956 31450 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:43:24.839129 31464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:24.841230 31450 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:43:24.841574 31450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal
uuid: "d52c5ca8ad874c19af393b98bcd013c0"
format_stamp: "Formatted at 2026-08-08 02:43:24 on dist-test-slave-8tdl"
server_key: "617031cf00f07e24e82684738e8594ff"
server_key_iv: "572a85e642d2c974b661b0c2fcb16b18"
server_key_version: "encryptionkey@0"
I20260808 02:43:24.841861 31450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:24.861629 31450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:24.862808 31450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:24.863153 31450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:24.864441 31450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:24.866133 31450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:24.866230 31450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:24.866364 31450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:24.866456 31450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:24.904451 31450 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.66:40531
I20260808 02:43:24.904506 31583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.66:40531 every 8 connection(s)
I20260808 02:43:24.905972 31450 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/data/info.pb
I20260808 02:43:24.915771 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31450
I20260808 02:43:24.915985 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal/instance
I20260808 02:43:24.916574 10321 external_mini_cluster.cc:1428] Setting key 4b5a1be52ada540ec20cae59a4afbed5
I20260808 02:43:24.920723 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.20.67:0
--local_ip_for_outbound_sockets=127.10.20.67
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33801
--builtin_ntp_servers=127.10.20.84:45907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 02:43:24.921476 31586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:24.908840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.66:39469 (local address 127.10.20.126:33801)
0808 02:43:24.909490 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:24.909497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:24.910894 (+ 1397us) server_negotiation.cc:407] Connection header received
0808 02:43:24.912828 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:24.912833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:24.912916 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:24.913035 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:24.914256 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.915160 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.917688 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.918202 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.918329 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:24.920294 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:24.920300 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:24.920303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:24.920323 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:24.920375 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:24.920393 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:24.920481 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:24.920933 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 02:43:24.921080 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":444,"thread_start_us":289,"threads_started":1}
I20260808 02:43:24.922983 31587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:24.909571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:33801 (local address 127.10.20.66:39469)
0808 02:43:24.910642 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:24.910740 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:24.912475 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:24.913289 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:24.913298 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:24.913395 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:24.914016 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:24.914046 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.915358 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.915367 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:24.917458 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:24.917477 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:24.918522 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:24.918532 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:24.918883 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:24.919806 (+ 923us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:24.919810 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:24.919892 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:24.920026 (+ 134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:24.920521 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:24.920536 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:24.920545 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 02:43:24.920794 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 02:43:24.921320 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":399,"threads_started":1}
I20260808 02:43:24.925004 31584 heartbeater.cc:347] Connected to a master server at 127.10.20.126:33801
I20260808 02:43:24.925377 31584 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:24.926237 31584 heartbeater.cc:511] Master 127.10.20.126:33801 requested a full tablet report, sending...
I20260808 02:43:24.928097 31248 ts_manager.cc:194] Registered new tserver with Master: d52c5ca8ad874c19af393b98bcd013c0 (127.10.20.66:40531)
I20260808 02:43:24.929531 31248 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.66:39469
W20260808 02:43:25.308919 31588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:25.309492 31588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:25.309731 31588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:25.317934 31588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:25.318080 31588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:25.318231 31588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.20.67
I20260808 02:43:25.329110 31588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.20.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.20.67
--webserver_port=0
--tserver_master_addrs=127.10.20.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.20.67
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:25.331285 31588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:25.333877 31588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:25.352591 31594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:25.353437 31597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:25.353509 31595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:25.354163 31588 server_base.cc:1034] running on GCE node
I20260808 02:43:25.355070 31588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:25.356190 31588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:25.357471 31588 hybrid_clock.cc:648] HybridClock initialized: now 1786157005357315 us; error 141 us; skew 500 ppm
I20260808 02:43:25.357821 31588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 02:43:25.360764 31588 webserver.cc:460] Webserver started at http://127.10.20.67:37731/ using document root <none> and password file <none>
I20260808 02:43:25.361559 31588 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:25.361672 31588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:25.361969 31588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:25.366462 31588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data/instance:
uuid: "d842944cc35446f98568912c5db200a0"
format_stamp: "Formatted at 2026-08-08 02:43:25 on dist-test-slave-8tdl"
server_key: "35084c3915f84fc2351e4000ccf8c48f"
server_key_iv: "678f2da5125cfd40ebdf014238921e3d"
server_key_version: "encryptionkey@0"
I20260808 02:43:25.367766 31588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance:
uuid: "d842944cc35446f98568912c5db200a0"
format_stamp: "Formatted at 2026-08-08 02:43:25 on dist-test-slave-8tdl"
server_key: "35084c3915f84fc2351e4000ccf8c48f"
server_key_iv: "678f2da5125cfd40ebdf014238921e3d"
server_key_version: "encryptionkey@0"
I20260808 02:43:25.375262 31588 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:43:25.380789 31603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:25.383189 31588 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.003s
I20260808 02:43:25.383632 31588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal
uuid: "d842944cc35446f98568912c5db200a0"
format_stamp: "Formatted at 2026-08-08 02:43:25 on dist-test-slave-8tdl"
server_key: "35084c3915f84fc2351e4000ccf8c48f"
server_key_iv: "678f2da5125cfd40ebdf014238921e3d"
server_key_version: "encryptionkey@0"
I20260808 02:43:25.383970 31588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:25.409617 31588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:25.410652 31588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:25.411151 31588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:25.411583 31446 heartbeater.cc:503] Master 127.10.20.126:33801 was elected leader, sending a full tablet report...
I20260808 02:43:25.412559 31588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 02:43:25.416106 31588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 02:43:25.416280 31588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:25.416438 31588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 02:43:25.416538 31588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:25.465126 31588 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.67:41759
I20260808 02:43:25.465350 31718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.67:41759 every 8 connection(s)
I20260808 02:43:25.466745 31588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/data/info.pb
I20260808 02:43:25.474653 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31588
I20260808 02:43:25.474913 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal/instance
I20260808 02:43:25.476020 10321 external_mini_cluster.cc:1428] Setting key 1f2266133fd265e81f346a2ae6d2eea5
I20260808 02:43:25.486274 31721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.470103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:50957 (local address 127.10.20.126:33801)
0808 02:43:25.470612 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.470616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.472149 (+ 1533us) server_negotiation.cc:407] Connection header received
0808 02:43:25.475058 (+ 2909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.475063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.475177 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.475296 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:25.478128 (+ 2832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.479196 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.481684 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.482270 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.482412 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.485004 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:25.485011 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:25.485015 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:25.485042 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:25.485110 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:25.485125 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:25.485217 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.485727 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.485848 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":272,"threads_started":1}
I20260808 02:43:25.487602 31722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.470747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:33801 (local address 127.10.20.67:50957)
0808 02:43:25.471948 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:25.471998 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:25.474450 (+ 2452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:25.476276 (+ 1826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:25.476300 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:25.476566 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:43:25.477697 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.477766 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.479504 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.479513 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.481364 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.481382 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.482605 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.482612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.483050 (+ 438us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.484233 (+ 1183us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 02:43:25.484238 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:43:25.484312 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 02:43:25.484483 (+ 171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:43:25.485276 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:43:25.485291 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:43:25.485349 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 02:43:25.485689 (+ 340us) client_negotiation.cc:240] Negotiation successful
0808 02:43:25.486200 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":328,"threads_started":1}
I20260808 02:43:25.489316 31719 heartbeater.cc:347] Connected to a master server at 127.10.20.126:33801
I20260808 02:43:25.489699 31719 heartbeater.cc:464] Registering TS with master...
I20260808 02:43:25.490599 31719 heartbeater.cc:511] Master 127.10.20.126:33801 requested a full tablet report, sending...
I20260808 02:43:25.492779 31248 ts_manager.cc:194] Registered new tserver with Master: d842944cc35446f98568912c5db200a0 (127.10.20.67:41759)
I20260808 02:43:25.493711 31248 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.20.67:50957
I20260808 02:43:25.494199 10321 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 02:43:25.508317 31721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.499937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39004 (local address 127.10.20.126:33801)
0808 02:43:25.500245 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.500250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.500861 (+ 611us) server_negotiation.cc:407] Connection header received
0808 02:43:25.500936 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.500940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.501012 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.501111 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:25.501850 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.502767 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.505100 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.505601 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.505730 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.507380 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:25.507386 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:25.507390 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:25.507413 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:25.507453 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:25.507467 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:25.507594 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.507901 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.508001 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260808 02:43:25.513290 31248 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 02:43:25.521416 31248 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 02:43:25.557482 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.537837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43668 (local address 127.10.20.66:40531)
0808 02:43:25.548610 (+ 10773us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.548623 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.548665 (+ 42us) server_negotiation.cc:407] Connection header received
0808 02:43:25.548820 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.548832 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.549145 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.549375 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:25.550407 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.551966 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.554450 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.556148 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.556317 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.556597 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.556940 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.557128 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10608,"thread_start_us":10502,"threads_started":1}
I20260808 02:43:25.557515 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.537379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:40531 (local address 127.0.0.1:43668)
0808 02:43:25.547791 (+ 10412us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:25.547875 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:25.548143 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:25.549427 (+ 1284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:25.549437 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:25.549478 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:25.550130 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.550158 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.552126 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.552138 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.554167 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.554182 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.556401 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.556409 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.556648 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.556718 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 02:43:25.556875 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 02:43:25.557107 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9970,"mutex_wait_us":20,"thread_start_us":9765,"threads_started":1}
I20260808 02:43:25.560832 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.550008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.67:41759 (local address 127.0.0.1:41012)
0808 02:43:25.550783 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:25.550812 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:25.550961 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:25.551988 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:25.551992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:25.552012 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:25.552677 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.552690 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.555356 (+ 2666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.555362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.558142 (+ 2780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.558161 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.559895 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.559902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.560105 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.560142 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 02:43:25.560268 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 02:43:25.560422 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":136,"thread_start_us":452,"threads_started":1}
I20260808 02:43:25.562034 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.549464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41012 (local address 127.10.20.67:41759)
0808 02:43:25.550453 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.550462 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.551086 (+ 624us) server_negotiation.cc:407] Connection header received
0808 02:43:25.551204 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.551212 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.551469 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.551686 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:25.552903 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.555116 (+ 2213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.558394 (+ 3278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.559669 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.559826 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.560132 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.560321 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.561599 (+ 1278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":791,"thread_start_us":623,"threads_started":1}
I20260808 02:43:25.562108 31733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.537680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:37945 (local address 127.0.0.1:46674)
0808 02:43:25.549028 (+ 11348us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:25.549058 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:25.549199 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:25.551704 (+ 2505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:25.551709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:25.551739 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:25.552241 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.552254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.554513 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.554520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.558142 (+ 3622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.558161 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.560806 (+ 2645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.560818 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.561385 (+ 567us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.561424 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 02:43:25.561528 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 02:43:25.561681 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11207,"mutex_wait_us":187,"thread_start_us":11032,"threads_started":1}
I20260808 02:43:25.562507 31516 tablet_service.cc:1467] Processing CreateTablet for tablet b2e6c5969a884cf68d19731d348df00f (DEFAULT_TABLE table=test-table [id=62723b18f4aa4e8ca08f19b8365d0113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:25.563407 31735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.537944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46674 (local address 127.10.20.65:37945)
0808 02:43:25.551169 (+ 13225us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.551178 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.551203 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:43:25.551289 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.551295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.551491 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.551686 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:25.552464 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.554248 (+ 1784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.558498 (+ 4250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.560195 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.560352 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.560640 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.562629 (+ 1989us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.562900 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13018,"thread_start_us":12852,"threads_started":1}
I20260808 02:43:25.565322 31516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e6c5969a884cf68d19731d348df00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:25.565740 31653 tablet_service.cc:1467] Processing CreateTablet for tablet b2e6c5969a884cf68d19731d348df00f (DEFAULT_TABLE table=test-table [id=62723b18f4aa4e8ca08f19b8365d0113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:25.567212 31653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e6c5969a884cf68d19731d348df00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:25.567412 31376 tablet_service.cc:1467] Processing CreateTablet for tablet b2e6c5969a884cf68d19731d348df00f (DEFAULT_TABLE table=test-table [id=62723b18f4aa4e8ca08f19b8365d0113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 02:43:25.569321 31376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2e6c5969a884cf68d19731d348df00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:25.580629 31739 tablet_bootstrap.cc:492] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Bootstrap starting.
I20260808 02:43:25.583280 31740 tablet_bootstrap.cc:492] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Bootstrap starting.
I20260808 02:43:25.585309 31739 tablet_bootstrap.cc:654] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:25.586853 31739 log.cc:824] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:25.587369 31740 tablet_bootstrap.cc:654] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:25.586925 31741 tablet_bootstrap.cc:492] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Bootstrap starting.
I20260808 02:43:25.589030 31740 log.cc:824] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:25.591872 31741 tablet_bootstrap.cc:654] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:25.593158 31741 log.cc:824] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:25.593546 31740 tablet_bootstrap.cc:492] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: No bootstrap required, opened a new log
I20260808 02:43:25.593935 31740 ts_tablet_manager.cc:1397] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260808 02:43:25.597020 31741 tablet_bootstrap.cc:492] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: No bootstrap required, opened a new log
I20260808 02:43:25.597025 31739 tablet_bootstrap.cc:492] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: No bootstrap required, opened a new log
I20260808 02:43:25.597384 31739 ts_tablet_manager.cc:1397] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.008s
I20260808 02:43:25.597384 31741 ts_tablet_manager.cc:1397] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260808 02:43:25.603248 31740 raft_consensus.cc:348] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.603837 31740 raft_consensus.cc:374] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:25.603972 31740 raft_consensus.cc:729] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d52c5ca8ad874c19af393b98bcd013c0, State: Initialized, Role: FOLLOWER
I20260808 02:43:25.604673 31740 consensus_queue.cc:260] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.606007 31584 heartbeater.cc:503] Master 127.10.20.126:33801 was elected leader, sending a full tablet report...
I20260808 02:43:25.606884 31740 ts_tablet_manager.cc:1428] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Time spent starting tablet: real 0.013s user 0.011s sys 0.005s
I20260808 02:43:25.610029 31739 raft_consensus.cc:348] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.610020 31741 raft_consensus.cc:348] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.610576 31739 raft_consensus.cc:374] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:25.610577 31741 raft_consensus.cc:374] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:25.610723 31739 raft_consensus.cc:729] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d842944cc35446f98568912c5db200a0, State: Initialized, Role: FOLLOWER
I20260808 02:43:25.610718 31741 raft_consensus.cc:729] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e072f84b50347409ad0e2ae54a4e4db, State: Initialized, Role: FOLLOWER
I20260808 02:43:25.611457 31741 consensus_queue.cc:260] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.611454 31739 consensus_queue.cc:260] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.613217 31719 heartbeater.cc:503] Master 127.10.20.126:33801 was elected leader, sending a full tablet report...
I20260808 02:43:25.613724 31741 ts_tablet_manager.cc:1428] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260808 02:43:25.613777 31739 ts_tablet_manager.cc:1428] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Time spent starting tablet: real 0.016s user 0.015s sys 0.003s
W20260808 02:43:25.633577 31447 tablet.cc:2369] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 02:43:25.658401 31585 tablet.cc:2369] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:25.670157 31748 raft_consensus.cc:482] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 02:43:25.670550 31748 raft_consensus.cc:504] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.672873 31748 leader_election.cc:288] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d52c5ca8ad874c19af393b98bcd013c0 (127.10.20.66:40531), 0e072f84b50347409ad0e2ae54a4e4db (127.10.20.65:37945)
I20260808 02:43:25.680130 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.673457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:44113 (local address 127.10.20.66:40531)
0808 02:43:25.673711 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.673719 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.673751 (+ 32us) server_negotiation.cc:407] Connection header received
0808 02:43:25.674104 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.674112 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.674221 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.674331 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:25.675019 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.675828 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.678065 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.679030 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.679242 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.679328 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.679639 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.679806 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:43:25.680142 31722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.673373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.66:40531 (local address 127.10.20.67:44113)
0808 02:43:25.673649 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:25.673675 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:25.673843 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:25.674514 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:25.674522 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:25.674563 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:25.674843 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.674853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.675986 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.675995 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.677853 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.677868 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.679226 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.679234 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.679442 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.679469 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 02:43:25.679603 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 02:43:25.679779 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 02:43:25.680377 31735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.673962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.20.67:53097 (local address 127.10.20.65:37945)
0808 02:43:25.674190 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.674197 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.674577 (+ 380us) server_negotiation.cc:407] Connection header received
0808 02:43:25.674868 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.674873 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.674957 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.675073 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 02:43:25.675711 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.676463 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.678466 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.679364 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.679555 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.679624 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.679967 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.680105 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 02:43:25.680505 31749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.673458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.65:37945 (local address 127.10.20.67:53097)
0808 02:43:25.674413 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0808 02:43:25.674448 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 02:43:25.674591 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:43:25.675118 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:43:25.675123 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:43:25.675149 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 02:43:25.675526 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.675536 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.676620 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.676625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.678232 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:43:25.678244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.679577 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.679584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:43:25.679765 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.679789 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 02:43:25.679899 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 02:43:25.680046 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"mutex_wait_us":30,"thread_start_us":649,"threads_started":1}
I20260808 02:43:25.681392 31537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e6c5969a884cf68d19731d348df00f" candidate_uuid: "d842944cc35446f98568912c5db200a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d52c5ca8ad874c19af393b98bcd013c0" is_pre_election: true
I20260808 02:43:25.681522 31397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e6c5969a884cf68d19731d348df00f" candidate_uuid: "d842944cc35446f98568912c5db200a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e072f84b50347409ad0e2ae54a4e4db" is_pre_election: true
I20260808 02:43:25.681991 31537 raft_consensus.cc:2454] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d842944cc35446f98568912c5db200a0 in term 0.
I20260808 02:43:25.682152 31397 raft_consensus.cc:2454] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d842944cc35446f98568912c5db200a0 in term 0.
I20260808 02:43:25.682991 31604 leader_election.cc:302] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d52c5ca8ad874c19af393b98bcd013c0, d842944cc35446f98568912c5db200a0; no voters:
I20260808 02:43:25.683429 31748 raft_consensus.cc:2781] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 02:43:25.683607 31748 raft_consensus.cc:482] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 02:43:25.683753 31748 raft_consensus.cc:3037] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:25.686609 31748 raft_consensus.cc:504] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.687471 31748 leader_election.cc:288] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [CANDIDATE]: Term 1 election: Requested vote from peers d52c5ca8ad874c19af393b98bcd013c0 (127.10.20.66:40531), 0e072f84b50347409ad0e2ae54a4e4db (127.10.20.65:37945)
I20260808 02:43:25.688129 31397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e6c5969a884cf68d19731d348df00f" candidate_uuid: "d842944cc35446f98568912c5db200a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e072f84b50347409ad0e2ae54a4e4db"
I20260808 02:43:25.688128 31537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2e6c5969a884cf68d19731d348df00f" candidate_uuid: "d842944cc35446f98568912c5db200a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d52c5ca8ad874c19af393b98bcd013c0"
I20260808 02:43:25.688380 31537 raft_consensus.cc:3037] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:25.688380 31397 raft_consensus.cc:3037] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:25.691231 31537 raft_consensus.cc:2454] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d842944cc35446f98568912c5db200a0 in term 1.
I20260808 02:43:25.691229 31397 raft_consensus.cc:2454] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d842944cc35446f98568912c5db200a0 in term 1.
I20260808 02:43:25.691787 31606 leader_election.cc:302] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e072f84b50347409ad0e2ae54a4e4db, d842944cc35446f98568912c5db200a0; no voters:
I20260808 02:43:25.692297 31748 raft_consensus.cc:2781] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:25.692868 31748 raft_consensus.cc:686] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 1 LEADER]: Becoming Leader. State: Replica: d842944cc35446f98568912c5db200a0, State: Running, Role: LEADER
I20260808 02:43:25.693502 31748 consensus_queue.cc:237] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } }
I20260808 02:43:25.699424 31247 catalog_manager.cc:5495] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to d842944cc35446f98568912c5db200a0 (127.10.20.67). New cstate: current_term: 1 leader_uuid: "d842944cc35446f98568912c5db200a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d842944cc35446f98568912c5db200a0" member_type: VOTER last_known_addr { host: "127.10.20.67" port: 41759 } health_report { overall_health: HEALTHY } } }
W20260808 02:43:25.719087 31720 tablet.cc:2369] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:43:25.747180 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.740882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41028 (local address 127.10.20.67:41759)
0808 02:43:25.741142 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.741149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.741173 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:43:25.741337 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.741341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.741447 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.741638 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:43:25.742063 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.742970 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.744546 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.745042 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.745199 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.745811 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:43:25.746435 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:43:25.746610 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.746770 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.746875 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 02:43:25.757529 31397 raft_consensus.cc:1261] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 1 FOLLOWER]: Refusing update from remote peer d842944cc35446f98568912c5db200a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:25.757542 31537 raft_consensus.cc:1261] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 1 FOLLOWER]: Refusing update from remote peer d842944cc35446f98568912c5db200a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:43:25.758752 31748 consensus_queue.cc:1035] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d52c5ca8ad874c19af393b98bcd013c0" member_type: VOTER last_known_addr { host: "127.10.20.66" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:25.759202 31750 consensus_queue.cc:1035] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e072f84b50347409ad0e2ae54a4e4db" member_type: VOTER last_known_addr { host: "127.10.20.65" port: 37945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:43:25.776134 31754 mvcc.cc:205] Tried to move back new op lower bound from 7316099095568859136 to 7316099095326633984. Current Snapshot: MvccSnapshot[applied={T|T < 7316099095568859136}]
I20260808 02:43:25.795395 31247 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:25.795728 31247 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 02:43:25.800192 31247 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 794ccc501f2c46dab5c70776a60fd57c: Sending DeleteTablet for 3 replicas of tablet b2e6c5969a884cf68d19731d348df00f
I20260808 02:43:25.801601 31516 tablet_service.cc:1514] Processing DeleteTablet for tablet b2e6c5969a884cf68d19731d348df00f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:25 UTC) from {username='slave'} at 127.0.0.1:43668
I20260808 02:43:25.801775 31376 tablet_service.cc:1514] Processing DeleteTablet for tablet b2e6c5969a884cf68d19731d348df00f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:25 UTC) from {username='slave'} at 127.0.0.1:46674
I20260808 02:43:25.802591 31653 tablet_service.cc:1514] Processing DeleteTablet for tablet b2e6c5969a884cf68d19731d348df00f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 02:43:25 UTC) from {username='slave'} at 127.0.0.1:41012
I20260808 02:43:25.802798 31764 tablet_replica.cc:330] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: stopping tablet replica
I20260808 02:43:25.803490 31764 raft_consensus.cc:2229] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:25.804189 31764 raft_consensus.cc:2258] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:25.805480 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31310
I20260808 02:43:25.807317 31764 ts_tablet_manager.cc:1905] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:25.814630 31766 tablet_replica.cc:330] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: stopping tablet replica
I20260808 02:43:25.815505 31766 raft_consensus.cc:2229] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 02:43:25.815657 31765 tablet_replica.cc:330] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: stopping tablet replica
I20260808 02:43:25.816329 31765 raft_consensus.cc:2229] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 02:43:25.816560 31766 raft_consensus.cc:2258] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:25.817087 31765 raft_consensus.cc:2258] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 02:43:25.821733 31765 ts_tablet_manager.cc:1905] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:25.822610 31766 ts_tablet_manager.cc:1905] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 02:43:25.830796 31765 ts_tablet_manager.cc:1918] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:25.832553 31766 ts_tablet_manager.cc:1918] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:25.832835 31766 log.cc:1196] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-2/wal/wals/b2e6c5969a884cf68d19731d348df00f
I20260808 02:43:25.833331 31764 ts_tablet_manager.cc:1918] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 02:43:25.834065 31766 ts_tablet_manager.cc:1939] T b2e6c5969a884cf68d19731d348df00f P d842944cc35446f98568912c5db200a0: Deleting consensus metadata
I20260808 02:43:25.834053 31764 log.cc:1196] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-1/wal/wals/b2e6c5969a884cf68d19731d348df00f
I20260808 02:43:25.835318 31764 ts_tablet_manager.cc:1939] T b2e6c5969a884cf68d19731d348df00f P d52c5ca8ad874c19af393b98bcd013c0: Deleting consensus metadata
I20260808 02:43:25.836407 31231 catalog_manager.cc:4841] TS d842944cc35446f98568912c5db200a0 (127.10.20.67:41759): tablet b2e6c5969a884cf68d19731d348df00f (table test-table [id=62723b18f4aa4e8ca08f19b8365d0113]) successfully deleted
I20260808 02:43:25.838047 31765 log.cc:1196] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Deleting WAL directory at /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786156633487900-10321-0/minicluster-data/ts-0/wal/wals/b2e6c5969a884cf68d19731d348df00f
I20260808 02:43:25.834790 31735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.807964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46680 (local address 127.10.20.65:37945)
0808 02:43:25.808219 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.808229 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.823461 (+ 15232us) server_negotiation.cc:407] Connection header received
0808 02:43:25.824080 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.824089 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.824227 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.824317 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:25.825051 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.826325 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.829114 (+ 2789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.829992 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.830128 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.832028 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:25.832046 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:25.832070 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:25.833080 (+ 1010us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:25.833163 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:25.833198 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:25.833314 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.834127 (+ 813us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.834292 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:43:25.838196 31229 catalog_manager.cc:4841] TS d52c5ca8ad874c19af393b98bcd013c0 (127.10.20.66:40531): tablet b2e6c5969a884cf68d19731d348df00f (table test-table [id=62723b18f4aa4e8ca08f19b8365d0113]) successfully deleted
I20260808 02:43:25.838851 31765 ts_tablet_manager.cc:1939] T b2e6c5969a884cf68d19731d348df00f P 0e072f84b50347409ad0e2ae54a4e4db: Deleting consensus metadata
I20260808 02:43:25.839174 31441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:25.940528 31231 catalog_manager.cc:4841] TS 0e072f84b50347409ad0e2ae54a4e4db (127.10.20.65:37945): tablet b2e6c5969a884cf68d19731d348df00f (table test-table [id=62723b18f4aa4e8ca08f19b8365d0113]) successfully deleted
I20260808 02:43:25.940878 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31310
I20260808 02:43:25.964314 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31450
I20260808 02:43:25.973898 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:25.965357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43672 (local address 127.10.20.66:40531)
0808 02:43:25.965538 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:25.965543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:25.965563 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:43:25.965735 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:25.965739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:25.965857 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:25.965992 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:25.966502 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.967538 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.969954 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:25.970481 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:25.970603 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:25.972234 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:25.972245 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:25.972260 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:25.972908 (+ 648us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:25.973034 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:25.973067 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:25.973219 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:25.973359 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 02:43:25.973491 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:43:25.975003 31578 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:26.073114 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31450
I20260808 02:43:26.095191 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31588
I20260808 02:43:26.104630 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:26.096252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41030 (local address 127.10.20.67:41759)
0808 02:43:26.096482 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:26.096488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:26.096513 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:43:26.096681 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:26.096691 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:26.096811 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:26.096959 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:26.097404 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:26.098608 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:26.100383 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:26.101117 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:26.101270 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:26.102484 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:26.102496 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:26.102514 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:26.103571 (+ 1057us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:26.103648 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:26.103676 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:26.103808 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:26.104027 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 02:43:26.104155 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 02:43:26.105551 31714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:26.233407 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31588
I20260808 02:43:26.256662 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31213
I20260808 02:43:26.258127 31280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:26.377625 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31213
2026-08-08T02:43:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3268 ms)
[----------] 6 tests from EncryptionPolicyTest (24900 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:26 dist-test-slave-8tdl krb5kdc[31775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:26 dist-test-slave-8tdl krb5kdc[31775](info): set up 2 sockets
Aug 08 02:43:26 dist-test-slave-8tdl krb5kdc[31775](info): commencing operation
krb5kdc: starting...
W20260808 02:43:27.623221 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.006s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:27 dist-test-slave-8tdl krb5kdc[31775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:28.029279 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45155
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:28.421252 31789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:28.421614 31789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:28.421717 31789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:28.430111 31789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:28.430274 31789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:28.430404 31789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:28.430527 31789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:28.430584 31789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:28.441861 31789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45155
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:28.443445 31789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:28.444944 31789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:28.460522 31795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:28.460407 31794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:28.460721 31797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:28.461550 31789 server_base.cc:1034] running on GCE node
I20260808 02:43:28.462589 31789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:28.464394 31789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:28.465709 31789 hybrid_clock.cc:648] HybridClock initialized: now 1786157008465674 us; error 58 us; skew 500 ppm
I20260808 02:43:28.466212 31789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:28 dist-test-slave-8tdl krb5kdc[31775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157008, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:28.474653 31789 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:28.476863 31789 webserver.cc:460] Webserver started at http://127.0.0.1:35893/ using document root <none> and password file <none>
I20260808 02:43:28.477741 31789 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:28.477939 31789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:28.478332 31789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:28.482229 31789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "4957e580f3e74f54a62389fd605e5c26"
format_stamp: "Formatted at 2026-08-08 02:43:28 on dist-test-slave-8tdl"
server_key: "019fac2716e85fd9348dc1b82a4e6d58"
server_key_iv: "a7412845694c3643588210d156416648"
server_key_version: "encryptionkey@0"
I20260808 02:43:28.483301 31789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "4957e580f3e74f54a62389fd605e5c26"
format_stamp: "Formatted at 2026-08-08 02:43:28 on dist-test-slave-8tdl"
server_key: "019fac2716e85fd9348dc1b82a4e6d58"
server_key_iv: "a7412845694c3643588210d156416648"
server_key_version: "encryptionkey@0"
I20260808 02:43:28.490875 31789 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:43:28.496131 31804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:28.498029 31789 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 02:43:28.498318 31789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "4957e580f3e74f54a62389fd605e5c26"
format_stamp: "Formatted at 2026-08-08 02:43:28 on dist-test-slave-8tdl"
server_key: "019fac2716e85fd9348dc1b82a4e6d58"
server_key_iv: "a7412845694c3643588210d156416648"
server_key_version: "encryptionkey@0"
I20260808 02:43:28.498596 31789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:28.517118 31789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:28.523023 31789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:28.523375 31789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:28.546398 31789 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45155
I20260808 02:43:28.546424 31857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45155 every 8 connection(s)
I20260808 02:43:28.548193 31789 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:28.551363 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31789
I20260808 02:43:28.551651 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:28.552667 10321 external_mini_cluster.cc:1428] Setting key 2bb5860d3cc275f31ea7eb9200644772
I20260808 02:43:28.554318 31858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:43:28 dist-test-slave-8tdl krb5kdc[31775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:43:28.572109 31858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26: Bootstrap starting.
I20260808 02:43:28.576311 31858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:28.577610 31858 log.cc:824] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:28.582190 31861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:28.555127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60705 (local address 127.0.0.1:45155)
0808 02:43:28.556086 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:28.556099 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:28.556145 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:43:28.557886 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:28.557912 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:28.558392 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:28.558883 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:28.561201 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:28.562832 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:28.565029 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:28.565955 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:28.566152 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:28.572167 (+ 6015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:28.572177 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:28.572196 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:28.572305 (+ 109us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:28.575981 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:28.577180 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:28.577189 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:28.577197 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:28.577396 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:28.577971 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:28.577977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:28.577980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:28.578937 (+ 957us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:28.579266 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:28.580175 (+ 909us) server_negotiation.cc:299] Negotiation successful
0808 02:43:28.580597 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":477,"threads_started":1}
I20260808 02:43:28.582306 31858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26: No bootstrap required, opened a new log
I20260808 02:43:28.587560 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:28.594372 31858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4957e580f3e74f54a62389fd605e5c26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45155 } }
I20260808 02:43:28.595352 31858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:28.595505 31858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4957e580f3e74f54a62389fd605e5c26, State: Initialized, Role: FOLLOWER
I20260808 02:43:28.596320 31858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4957e580f3e74f54a62389fd605e5c26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45155 } }
I20260808 02:43:28.596704 31858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:28.596894 31858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:28.597107 31858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:28.600365 31858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4957e580f3e74f54a62389fd605e5c26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45155 } }
I20260808 02:43:28.601119 31858 leader_election.cc:302] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4957e580f3e74f54a62389fd605e5c26; no voters:
I20260808 02:43:28.602098 31858 leader_election.cc:288] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:28.602336 31868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:28.604830 31868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [term 1 LEADER]: Becoming Leader. State: Replica: 4957e580f3e74f54a62389fd605e5c26, State: Running, Role: LEADER
I20260808 02:43:28.605479 31858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:28.605568 31868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4957e580f3e74f54a62389fd605e5c26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45155 } }
I20260808 02:43:28.609347 31869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4957e580f3e74f54a62389fd605e5c26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4957e580f3e74f54a62389fd605e5c26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45155 } } }
I20260808 02:43:28.609818 31869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:28.614104 31870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4957e580f3e74f54a62389fd605e5c26. Latest consensus state: current_term: 1 leader_uuid: "4957e580f3e74f54a62389fd605e5c26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4957e580f3e74f54a62389fd605e5c26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45155 } } }
I20260808 02:43:28.614603 31870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:28.616524 31874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:28.618953 31861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:28.594791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60601 (local address 127.0.0.1:45155)
0808 02:43:28.595070 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:28.595077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:28.595726 (+ 649us) server_negotiation.cc:407] Connection header received
0808 02:43:28.596028 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:28.596034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:28.596139 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:28.596293 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:28.598563 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:28.599698 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:28.601766 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:28.602971 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:28.604601 (+ 1630us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:28.607834 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:28.607847 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:28.607855 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:28.607923 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:28.613418 (+ 5495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:28.615333 (+ 1915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:28.615353 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:28.615359 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:28.615651 (+ 292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:28.616482 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:28.616490 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:28.616496 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:28.617084 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:28.617425 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:28.617985 (+ 560us) server_negotiation.cc:299] Negotiation successful
0808 02:43:28.618301 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 02:43:28.623974 31874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:28.637023 31874 catalog_manager.cc:1347] Generated new cluster ID: 97649e2590e44349975cac6513ae1efb
I20260808 02:43:28.637185 31874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:28.653044 31874 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:28.654470 31874 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:28.664937 31874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4957e580f3e74f54a62389fd605e5c26: Generated new TSK 0
I20260808 02:43:28.666342 31874 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:28.675117 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31789
I20260808 02:43:28.677603 31853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:28.778441 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31789
W20260808 02:43:28.802182 31773 connection.cc:535] client connection to 127.0.0.1:45155 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45155): Connection reset by peer (error 104)
2026-08-08T02:43:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2394 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:28 dist-test-slave-8tdl krb5kdc[31892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:28 dist-test-slave-8tdl krb5kdc[31892](info): set up 2 sockets
Aug 08 02:43:28 dist-test-slave-8tdl krb5kdc[31892](info): commencing operation
krb5kdc: starting...
W20260808 02:43:30.055212 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.003s sys 0.067s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:30 dist-test-slave-8tdl krb5kdc[31892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:30.459550 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38257
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:30.867377 31905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:30.867730 31905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:30.867908 31905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:30.876173 31905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:30.876324 31905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:30.876422 31905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:30.876520 31905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:30.876623 31905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:30.889464 31905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38257
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:30.891122 31905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:30.892956 31905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:30.907750 31910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:30.907809 31913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:30.907857 31911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:30.910149 31905 server_base.cc:1034] running on GCE node
I20260808 02:43:30.911278 31905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:30.913336 31905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:30.914639 31905 hybrid_clock.cc:648] HybridClock initialized: now 1786157010914590 us; error 44 us; skew 500 ppm
I20260808 02:43:30.915220 31905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:30 dist-test-slave-8tdl krb5kdc[31892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157010, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:30.919322 31905 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:30.921365 31905 webserver.cc:460] Webserver started at http://127.0.0.1:37157/ using document root <none> and password file <none>
I20260808 02:43:30.922183 31905 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:30.922305 31905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:30.922755 31905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:30.926160 31905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "1421838627744831932df774063cd5e1"
format_stamp: "Formatted at 2026-08-08 02:43:30 on dist-test-slave-8tdl"
server_key: "4b32d7f9e31fe0bfdec3cf098c075d5b"
server_key_iv: "810143936c8c29db9bb8e836ecb1c909"
server_key_version: "encryptionkey@0"
I20260808 02:43:30.927137 31905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "1421838627744831932df774063cd5e1"
format_stamp: "Formatted at 2026-08-08 02:43:30 on dist-test-slave-8tdl"
server_key: "4b32d7f9e31fe0bfdec3cf098c075d5b"
server_key_iv: "810143936c8c29db9bb8e836ecb1c909"
server_key_version: "encryptionkey@0"
I20260808 02:43:30.933367 31905 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 02:43:30.937860 31920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:30.939824 31905 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:43:30.940078 31905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "1421838627744831932df774063cd5e1"
format_stamp: "Formatted at 2026-08-08 02:43:30 on dist-test-slave-8tdl"
server_key: "4b32d7f9e31fe0bfdec3cf098c075d5b"
server_key_iv: "810143936c8c29db9bb8e836ecb1c909"
server_key_version: "encryptionkey@0"
I20260808 02:43:30.940366 31905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:30.963203 31905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:30.968762 31905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:30.969079 31905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:30.991010 31905 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38257
I20260808 02:43:30.991125 31973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38257 every 8 connection(s)
I20260808 02:43:30.992671 31905 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:30.997056 31974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:31.002151 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 31905
I20260808 02:43:31.002380 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:31.003695 10321 external_mini_cluster.cc:1428] Setting key 6118fdd3c935ca95f4e9e523a62d7771
I20260808 02:43:31.012392 31974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1: Bootstrap starting.
I20260808 02:43:31.017421 31974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:31.019897 31974 log.cc:824] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:31.025199 31977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:31.006570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39165 (local address 127.0.0.1:38257)
0808 02:43:31.007670 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:31.007691 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:31.007761 (+ 70us) server_negotiation.cc:407] Connection header received
0808 02:43:31.010580 (+ 2819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:31.010617 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:31.011310 (+ 693us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:31.011868 (+ 558us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:31.012494 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:31.015181 (+ 2687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:31.017202 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:31.019245 (+ 2043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:31.019623 (+ 378us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:31.021584 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:31.021594 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:31.021763 (+ 169us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:31.022417 (+ 654us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:31.022513 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:31.022550 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:31.022753 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:31.023487 (+ 734us) server_negotiation.cc:299] Negotiation successful
0808 02:43:31.023875 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":783,"thread_start_us":448,"threads_started":1}
I20260808 02:43:31.025346 31974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1: No bootstrap required, opened a new log
I20260808 02:43:31.030607 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:31.037388 31974 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1421838627744831932df774063cd5e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38257 } }
I20260808 02:43:31.038031 31974 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:31.038187 31974 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1421838627744831932df774063cd5e1, State: Initialized, Role: FOLLOWER
I20260808 02:43:31.038939 31974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1421838627744831932df774063cd5e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38257 } }
I20260808 02:43:31.039263 31974 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:31.039443 31974 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:31.039636 31974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:31.043125 31974 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1421838627744831932df774063cd5e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38257 } }
I20260808 02:43:31.043963 31974 leader_election.cc:302] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1421838627744831932df774063cd5e1; no voters:
I20260808 02:43:31.045254 31974 leader_election.cc:288] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:31.045666 31985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:31.047116 31977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:31.037500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38691 (local address 127.0.0.1:38257)
0808 02:43:31.037777 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:31.037784 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:31.038351 (+ 567us) server_negotiation.cc:407] Connection header received
0808 02:43:31.038881 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:31.038886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:31.038976 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:31.039097 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:31.039760 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:31.040608 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:31.042105 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:31.042633 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:31.042845 (+ 212us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:31.044711 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:31.044717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:31.044720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:31.044886 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:31.045118 (+ 232us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:31.045155 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:31.045344 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:31.046051 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 02:43:31.046129 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 02:43:31.047222 31985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [term 1 LEADER]: Becoming Leader. State: Replica: 1421838627744831932df774063cd5e1, State: Running, Role: LEADER
I20260808 02:43:31.049341 31985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1421838627744831932df774063cd5e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38257 } }
I20260808 02:43:31.050912 31974 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:31.053165 31986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1421838627744831932df774063cd5e1. Latest consensus state: current_term: 1 leader_uuid: "1421838627744831932df774063cd5e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1421838627744831932df774063cd5e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38257 } } }
I20260808 02:43:31.053684 31986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:31.054701 31987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1421838627744831932df774063cd5e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1421838627744831932df774063cd5e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38257 } } }
I20260808 02:43:31.055387 31987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:31.057106 31992 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:31.067390 31992 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:31.084717 31992 catalog_manager.cc:1347] Generated new cluster ID: 1d638bcebdae4b6aae0649a8b8926054
I20260808 02:43:31.085137 31992 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:31.095709 31992 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:31.097486 31992 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:31.106103 31992 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1421838627744831932df774063cd5e1: Generated new TSK 0
I20260808 02:43:31.107369 31992 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:31.122218 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31905
W20260808 02:43:31.123929 31969 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39165
W20260808 02:43:31.125408 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 31905: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:31.125654 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 31905
W20260808 02:43:31.148952 31890 connection.cc:535] client connection to 127.0.0.1:38257 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38257): Connection reset by peer (error 104)
2026-08-08T02:43:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2346 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:31 dist-test-slave-8tdl krb5kdc[32008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:31 dist-test-slave-8tdl krb5kdc[32008](info): set up 2 sockets
Aug 08 02:43:31 dist-test-slave-8tdl krb5kdc[32008](info): commencing operation
krb5kdc: starting...
W20260808 02:43:32.413887 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:32 dist-test-slave-8tdl krb5kdc[32008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:32.816334 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35059
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:33.199311 32021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:33.199721 32021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:33.199908 32021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:33.208671 32021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:33.208868 32021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:33.208972 32021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:33.209069 32021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:33.209134 32021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:33.223237 32021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35059
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:33.224841 32021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:33.226290 32021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:33.241549 32032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:33.241528 32029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:33.241667 32028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:33.242507 32021 server_base.cc:1034] running on GCE node
I20260808 02:43:33.243520 32021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:33.245374 32021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:33.246755 32021 hybrid_clock.cc:648] HybridClock initialized: now 1786157013246648 us; error 76 us; skew 500 ppm
I20260808 02:43:33.247241 32021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:33 dist-test-slave-8tdl krb5kdc[32008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157013, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:33.251266 32021 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:33.253285 32021 webserver.cc:460] Webserver started at http://127.0.0.1:34937/ using document root <none> and password file <none>
I20260808 02:43:33.254105 32021 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:33.254576 32021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:33.255107 32021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:33.259044 32021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "97f8af922dd1464dafad7eac8c150990"
format_stamp: "Formatted at 2026-08-08 02:43:33 on dist-test-slave-8tdl"
server_key: "e97856ef1032f750ddb8fbca1ce7daa3"
server_key_iv: "e8e518f576af4c5cea40b7c38c874925"
server_key_version: "encryptionkey@0"
I20260808 02:43:33.260138 32021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "97f8af922dd1464dafad7eac8c150990"
format_stamp: "Formatted at 2026-08-08 02:43:33 on dist-test-slave-8tdl"
server_key: "e97856ef1032f750ddb8fbca1ce7daa3"
server_key_iv: "e8e518f576af4c5cea40b7c38c874925"
server_key_version: "encryptionkey@0"
I20260808 02:43:33.267328 32021 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 02:43:33.272503 32039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:33.275079 32021 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260808 02:43:33.275362 32021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "97f8af922dd1464dafad7eac8c150990"
format_stamp: "Formatted at 2026-08-08 02:43:33 on dist-test-slave-8tdl"
server_key: "e97856ef1032f750ddb8fbca1ce7daa3"
server_key_iv: "e8e518f576af4c5cea40b7c38c874925"
server_key_version: "encryptionkey@0"
I20260808 02:43:33.275668 32021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:33.283025 32021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:33.288589 32021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:33.288978 32021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:33.312348 32021 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35059
I20260808 02:43:33.312436 32093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35059 every 8 connection(s)
I20260808 02:43:33.314075 32021 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:33.317162 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32021
I20260808 02:43:33.317426 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:33.317961 10321 external_mini_cluster.cc:1428] Setting key c3527cc53a18dd7af792d1e036cdf089
I20260808 02:43:33.318640 32094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:33.328495 32097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:33.320098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42619 (local address 127.0.0.1:35059)
0808 02:43:33.321071 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:33.321085 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:33.321133 (+ 48us) server_negotiation.cc:407] Connection header received
0808 02:43:33.324082 (+ 2949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:33.324113 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:33.324577 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:33.325015 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:33.326414 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:33.326422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:33.326441 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:33.326475 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:33.326550 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:33.326579 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:33.327032 (+ 453us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:33.327229 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 02:43:33.327471 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":455,"threads_started":1}
I20260808 02:43:33.333101 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:33.334357 32094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990: Bootstrap starting.
I20260808 02:43:33.338990 32094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:33.340580 32094 log.cc:824] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:33.342443 32097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:33.339050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40801 (local address 127.0.0.1:35059)
0808 02:43:33.339224 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:33.339228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:33.339829 (+ 601us) server_negotiation.cc:407] Connection header received
0808 02:43:33.340080 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:33.340085 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:33.340148 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:33.340248 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:33.341445 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:33.341455 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:33.341462 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:33.341491 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:33.341559 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:33.341590 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:33.341759 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:33.341984 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 02:43:33.342062 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 02:43:33.344785 32094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990: No bootstrap required, opened a new log
I20260808 02:43:33.354084 32094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f8af922dd1464dafad7eac8c150990" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35059 } }
I20260808 02:43:33.354584 32094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:33.354754 32094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f8af922dd1464dafad7eac8c150990, State: Initialized, Role: FOLLOWER
I20260808 02:43:33.355396 32094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f8af922dd1464dafad7eac8c150990" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35059 } }
I20260808 02:43:33.355657 32094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:33.355818 32094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:33.355994 32094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:33.358601 32094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f8af922dd1464dafad7eac8c150990" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35059 } }
I20260808 02:43:33.359210 32094 leader_election.cc:302] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97f8af922dd1464dafad7eac8c150990; no voters:
I20260808 02:43:33.359884 32094 leader_election.cc:288] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:33.360095 32104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:33.360888 32104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [term 1 LEADER]: Becoming Leader. State: Replica: 97f8af922dd1464dafad7eac8c150990, State: Running, Role: LEADER
I20260808 02:43:33.361541 32104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f8af922dd1464dafad7eac8c150990" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35059 } }
I20260808 02:43:33.362538 32094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:33.364943 32105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97f8af922dd1464dafad7eac8c150990" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f8af922dd1464dafad7eac8c150990" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35059 } } }
I20260808 02:43:33.365347 32105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:33.366182 32106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97f8af922dd1464dafad7eac8c150990. Latest consensus state: current_term: 1 leader_uuid: "97f8af922dd1464dafad7eac8c150990" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97f8af922dd1464dafad7eac8c150990" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35059 } } }
I20260808 02:43:33.366815 32106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:33.372344 32109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:33.379403 32109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:33.390588 32109 catalog_manager.cc:1347] Generated new cluster ID: 4d46ad332d6c4f2689948e69c5abc995
I20260808 02:43:33.390769 32109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:33.413684 32109 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:33.414275 32109 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:33.426518 32109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97f8af922dd1464dafad7eac8c150990: Generated new TSK 0
I20260808 02:43:33.427551 32109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:33.437296 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32021
W20260808 02:43:33.439002 32089 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42619
W20260808 02:43:33.440272 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32021: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:33.440476 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32021
2026-08-08T02:43:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2314 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:33 dist-test-slave-8tdl krb5kdc[32128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:33 dist-test-slave-8tdl krb5kdc[32128](info): set up 2 sockets
Aug 08 02:43:33 dist-test-slave-8tdl krb5kdc[32128](info): commencing operation
krb5kdc: starting...
W20260808 02:43:34.707516 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:34 dist-test-slave-8tdl krb5kdc[32128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:35.129581 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44925
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:35.547938 32141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:35.548286 32141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:35.548386 32141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:35.556341 32141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:35.556641 32141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:35.556739 32141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:35.556803 32141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:35.556843 32141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:35.567970 32141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:35.569386 32141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:35.570901 32141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:35.585395 32147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:35.585353 32150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:35.585768 32141 server_base.cc:1034] running on GCE node
W20260808 02:43:35.585330 32148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:35.587044 32141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:35.589262 32141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:35.590766 32141 hybrid_clock.cc:648] HybridClock initialized: now 1786157015590635 us; error 56 us; skew 500 ppm
I20260808 02:43:35.591423 32141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:35 dist-test-slave-8tdl krb5kdc[32128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157015, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:35.595674 32141 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:35.598122 32141 webserver.cc:460] Webserver started at http://127.0.0.1:37393/ using document root <none> and password file <none>
I20260808 02:43:35.599074 32141 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:35.599249 32141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:35.599601 32141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:35.603302 32141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "ae79b10cd06442d1a4f0082894b7ffa2"
format_stamp: "Formatted at 2026-08-08 02:43:35 on dist-test-slave-8tdl"
server_key: "bdb606cf19d0d4f7ec68b912aba203c0"
server_key_iv: "3a46a5ad7edcea41b462f6ef9d3ecec1"
server_key_version: "encryptionkey@0"
I20260808 02:43:35.604305 32141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "ae79b10cd06442d1a4f0082894b7ffa2"
format_stamp: "Formatted at 2026-08-08 02:43:35 on dist-test-slave-8tdl"
server_key: "bdb606cf19d0d4f7ec68b912aba203c0"
server_key_iv: "3a46a5ad7edcea41b462f6ef9d3ecec1"
server_key_version: "encryptionkey@0"
I20260808 02:43:35.610955 32141 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:43:35.615428 32157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:35.617417 32141 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:43:35.617687 32141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "ae79b10cd06442d1a4f0082894b7ffa2"
format_stamp: "Formatted at 2026-08-08 02:43:35 on dist-test-slave-8tdl"
server_key: "bdb606cf19d0d4f7ec68b912aba203c0"
server_key_iv: "3a46a5ad7edcea41b462f6ef9d3ecec1"
server_key_version: "encryptionkey@0"
I20260808 02:43:35.617945 32141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:35.649552 32141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:35.655586 32141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:35.655938 32141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:35.679845 32141 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44925
I20260808 02:43:35.680194 32212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44925 every 8 connection(s)
I20260808 02:43:35.681603 32141 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:35.682930 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32141
I20260808 02:43:35.683131 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:35.683684 10321 external_mini_cluster.cc:1428] Setting key 979c2ce533fafeddc6429338818829ea
I20260808 02:43:35.688010 32213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:43:35 dist-test-slave-8tdl krb5kdc[32128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:43:35.701318 32213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2: Bootstrap starting.
I20260808 02:43:35.706089 32213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:35.707463 32213 log.cc:824] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:35.711374 32216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:35.685952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36027 (local address 127.0.0.1:44925)
0808 02:43:35.686974 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:35.686992 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:35.687373 (+ 381us) server_negotiation.cc:407] Connection header received
0808 02:43:35.689662 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:35.689688 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:35.690132 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:35.690612 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:35.692310 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:35.693797 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:35.695281 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:35.696047 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:35.696279 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:35.701533 (+ 5254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:35.701549 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:35.701574 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:35.701622 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:35.705708 (+ 4086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:35.706743 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:35.706754 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:35.706764 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:35.706980 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:35.707456 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:35.707464 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:35.707472 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:35.708250 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:35.708623 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:35.709212 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 02:43:35.709729 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":417,"threads_started":1}
I20260808 02:43:35.711848 32213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2: No bootstrap required, opened a new log
I20260808 02:43:35.717015 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:35.724705 32213 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44925 } }
I20260808 02:43:35.725394 32213 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:35.725625 32213 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae79b10cd06442d1a4f0082894b7ffa2, State: Initialized, Role: FOLLOWER
I20260808 02:43:35.726449 32213 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44925 } }
I20260808 02:43:35.726972 32213 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:35.727222 32213 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:35.727492 32213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:35.731098 32213 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44925 } }
I20260808 02:43:35.731762 32213 leader_election.cc:302] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae79b10cd06442d1a4f0082894b7ffa2; no voters:
I20260808 02:43:35.732586 32213 leader_election.cc:288] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:35.732774 32223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:35.733613 32223 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [term 1 LEADER]: Becoming Leader. State: Replica: ae79b10cd06442d1a4f0082894b7ffa2, State: Running, Role: LEADER
I20260808 02:43:35.734508 32223 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44925 } }
I20260808 02:43:35.735925 32213 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:35.739086 32226 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae79b10cd06442d1a4f0082894b7ffa2. Latest consensus state: current_term: 1 leader_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44925 } } }
I20260808 02:43:35.740429 32226 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:35.739326 32225 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae79b10cd06442d1a4f0082894b7ffa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44925 } } }
I20260808 02:43:35.740777 32225 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:35.750191 32216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:35.727227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43795 (local address 127.0.0.1:44925)
0808 02:43:35.727427 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:35.727434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:35.727879 (+ 445us) server_negotiation.cc:407] Connection header received
0808 02:43:35.728024 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:35.728030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:35.728119 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:35.728246 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:35.730526 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:35.731532 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:35.733661 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:35.734500 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:35.734665 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:35.738209 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:35.738216 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:35.738221 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:35.738276 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:35.744341 (+ 6065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:35.745745 (+ 1404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:35.745755 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:35.745762 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:35.746054 (+ 292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:35.746653 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:35.746662 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:35.746667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:35.747214 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:35.747594 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:35.749376 (+ 1782us) server_negotiation.cc:299] Negotiation successful
0808 02:43:35.749731 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:43:35.752842 32232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:35.759537 32232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:35.770380 32232 catalog_manager.cc:1347] Generated new cluster ID: d40201ef9a34445ab283fcef826ce279
I20260808 02:43:35.770538 32232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:35.798710 32232 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:35.800163 32232 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:35.822968 32232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae79b10cd06442d1a4f0082894b7ffa2: Generated new TSK 0
I20260808 02:43:35.824242 32232 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:35.839176 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32141
I20260808 02:43:35.840701 32207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:35.947824 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32141
2026-08-08T02:43:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2507 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:36 dist-test-slave-8tdl krb5kdc[32247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:36 dist-test-slave-8tdl krb5kdc[32247](info): set up 2 sockets
Aug 08 02:43:36 dist-test-slave-8tdl krb5kdc[32247](info): commencing operation
krb5kdc: starting...
W20260808 02:43:37.243551 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.005s sys 0.067s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:37 dist-test-slave-8tdl krb5kdc[32247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:37.656679 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39873
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:38.048770 32263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:38.049165 32263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:38.049335 32263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:38.057384 32263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:38.057585 32263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:38.057703 32263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:38.057816 32263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:38.057904 32263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:38.068946 32263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:38.070451 32263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:38.072038 32263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:38.086014 32270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:38.086164 32269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:38.086122 32272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:38.087126 32263 server_base.cc:1034] running on GCE node
I20260808 02:43:38.088110 32263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:38.089886 32263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:38.091248 32263 hybrid_clock.cc:648] HybridClock initialized: now 1786157018091198 us; error 42 us; skew 500 ppm
I20260808 02:43:38.091885 32263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:38 dist-test-slave-8tdl krb5kdc[32247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157018, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:38.095878 32263 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:38.097852 32263 webserver.cc:460] Webserver started at http://127.0.0.1:37005/ using document root <none> and password file <none>
I20260808 02:43:38.098788 32263 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:38.098963 32263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:38.099432 32263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:38.102991 32263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "3d0ac4c77e1041129b11a8f45c6c6e40"
format_stamp: "Formatted at 2026-08-08 02:43:38 on dist-test-slave-8tdl"
server_key: "97cb673c662207d947cbf9a4f5f22894"
server_key_iv: "1a1f0123f7032efd36bc032129b96eac"
server_key_version: "encryptionkey@0"
I20260808 02:43:38.103905 32263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "3d0ac4c77e1041129b11a8f45c6c6e40"
format_stamp: "Formatted at 2026-08-08 02:43:38 on dist-test-slave-8tdl"
server_key: "97cb673c662207d947cbf9a4f5f22894"
server_key_iv: "1a1f0123f7032efd36bc032129b96eac"
server_key_version: "encryptionkey@0"
I20260808 02:43:38.109943 32263 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260808 02:43:38.114431 32280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:38.116251 32263 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:38.116540 32263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "3d0ac4c77e1041129b11a8f45c6c6e40"
format_stamp: "Formatted at 2026-08-08 02:43:38 on dist-test-slave-8tdl"
server_key: "97cb673c662207d947cbf9a4f5f22894"
server_key_iv: "1a1f0123f7032efd36bc032129b96eac"
server_key_version: "encryptionkey@0"
I20260808 02:43:38.116784 32263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:38.138933 32263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:38.144146 32263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:38.144523 32263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:38.167166 32263 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39873
I20260808 02:43:38.167184 32333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39873 every 8 connection(s)
I20260808 02:43:38.168780 32263 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:38.170104 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32263
I20260808 02:43:38.170288 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:38.170827 10321 external_mini_cluster.cc:1428] Setting key bde14d164c082df36de1d38edfd802be
I20260808 02:43:38.173863 32334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:38.188383 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:38.172883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58961 (local address 127.0.0.1:39873)
0808 02:43:38.173823 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:38.173847 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:38.173905 (+ 58us) server_negotiation.cc:407] Connection header received
0808 02:43:38.176504 (+ 2599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:38.176546 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:38.177112 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:38.177683 (+ 571us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:38.178278 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:38.180475 (+ 2197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:38.182234 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:38.183419 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:38.183674 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:38.185036 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:38.185048 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:38.185071 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:38.185978 (+ 907us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:38.186095 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:38.186148 (+ 53us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:38.186271 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:38.186558 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 02:43:38.186918 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":406,"threads_started":1}
I20260808 02:43:38.189664 32334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40: Bootstrap starting.
I20260808 02:43:38.192808 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:38.193421 32334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:38.194571 32334 log.cc:824] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:38.198347 32334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40: No bootstrap required, opened a new log
I20260808 02:43:38.204722 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:38.197927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52137 (local address 127.0.0.1:39873)
0808 02:43:38.198102 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:38.198128 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:38.198665 (+ 537us) server_negotiation.cc:407] Connection header received
0808 02:43:38.198936 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:38.198940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:38.199067 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:38.199182 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:38.199729 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:38.200559 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:38.201911 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:38.202380 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:38.202535 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:38.203812 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:38.203818 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:38.203822 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:38.203845 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:38.203898 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:38.203915 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:38.204037 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:38.204201 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 02:43:38.204313 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 02:43:38.207837 32334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39873 } }
I20260808 02:43:38.208334 32334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:38.208451 32334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d0ac4c77e1041129b11a8f45c6c6e40, State: Initialized, Role: FOLLOWER
I20260808 02:43:38.209187 32334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39873 } }
I20260808 02:43:38.209506 32334 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:38.209694 32334 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:38.209910 32334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:38.212343 32334 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39873 } }
I20260808 02:43:38.212930 32334 leader_election.cc:302] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d0ac4c77e1041129b11a8f45c6c6e40; no voters:
I20260808 02:43:38.213567 32334 leader_election.cc:288] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:38.213773 32345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:38.214936 32345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [term 1 LEADER]: Becoming Leader. State: Replica: 3d0ac4c77e1041129b11a8f45c6c6e40, State: Running, Role: LEADER
I20260808 02:43:38.215689 32345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39873 } }
I20260808 02:43:38.216112 32334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:38.218617 32347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d0ac4c77e1041129b11a8f45c6c6e40. Latest consensus state: current_term: 1 leader_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39873 } } }
I20260808 02:43:38.219069 32347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:38.219664 32346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d0ac4c77e1041129b11a8f45c6c6e40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39873 } } }
I20260808 02:43:38.219990 32346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:38.220196 32351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:38.234460 32351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:38.247396 32351 catalog_manager.cc:1347] Generated new cluster ID: 10da400f3e09483084f6837ba0d4f943
I20260808 02:43:38.247611 32351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:38.256433 32351 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:38.258342 32351 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:38.272960 32351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d0ac4c77e1041129b11a8f45c6c6e40: Generated new TSK 0
I20260808 02:43:38.273957 32351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:38.287617 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32263
W20260808 02:43:38.289405 32329 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58961
W20260808 02:43:38.290246 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32263: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:38.290423 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32263
2026-08-08T02:43:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2340 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:38 dist-test-slave-8tdl krb5kdc[32367](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:38 dist-test-slave-8tdl krb5kdc[32367](info): set up 2 sockets
Aug 08 02:43:38 dist-test-slave-8tdl krb5kdc[32367](info): commencing operation
krb5kdc: starting...
W20260808 02:43:39.555042 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.003s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:39 dist-test-slave-8tdl krb5kdc[32367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:39.960675 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:40.368111 32381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:40.368535 32381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:40.368701 32381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:40.377079 32381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:40.377305 32381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:40.377578 32381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:40.377735 32381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:40.377826 32381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:40.389492 32381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:40.391152 32381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:40.392645 32381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:40.407485 32387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:40.407455 32390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:40.407433 32388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:40.408726 32381 server_base.cc:1034] running on GCE node
I20260808 02:43:40.409732 32381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:40.411514 32381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:40.412854 32381 hybrid_clock.cc:648] HybridClock initialized: now 1786157020412809 us; error 43 us; skew 500 ppm
I20260808 02:43:40.413370 32381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:40 dist-test-slave-8tdl krb5kdc[32367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157020, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:40.425580 32381 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:40.427888 32381 webserver.cc:460] Webserver started at http://127.0.0.1:34521/ using document root <none> and password file <none>
I20260808 02:43:40.428864 32381 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:40.429065 32381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:40.429436 32381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:40.433696 32381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "e452ecd79bff41c89ed7c6c05ee4403a"
format_stamp: "Formatted at 2026-08-08 02:43:40 on dist-test-slave-8tdl"
server_key: "c0a95b86de6b24e7e9420e3d1f58a6c1"
server_key_iv: "44dcf2df3ea1b337d483210b60ab0b6f"
server_key_version: "encryptionkey@0"
I20260808 02:43:40.435207 32381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "e452ecd79bff41c89ed7c6c05ee4403a"
format_stamp: "Formatted at 2026-08-08 02:43:40 on dist-test-slave-8tdl"
server_key: "c0a95b86de6b24e7e9420e3d1f58a6c1"
server_key_iv: "44dcf2df3ea1b337d483210b60ab0b6f"
server_key_version: "encryptionkey@0"
I20260808 02:43:40.443594 32381 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.005s
I20260808 02:43:40.448434 32397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:40.451308 32381 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.004s
I20260808 02:43:40.451617 32381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "e452ecd79bff41c89ed7c6c05ee4403a"
format_stamp: "Formatted at 2026-08-08 02:43:40 on dist-test-slave-8tdl"
server_key: "c0a95b86de6b24e7e9420e3d1f58a6c1"
server_key_iv: "44dcf2df3ea1b337d483210b60ab0b6f"
server_key_version: "encryptionkey@0"
I20260808 02:43:40.451894 32381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:40.459029 32381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:40.464205 32381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:40.464584 32381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:40.492687 32381 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34707
I20260808 02:43:40.492813 32449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34707 every 8 connection(s)
I20260808 02:43:40.494300 32381 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:40.498900 32450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:40.503517 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32381
I20260808 02:43:40.503748 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:40.504338 10321 external_mini_cluster.cc:1428] Setting key ea8371acf4410ecdc368241735728ceb
I20260808 02:43:40.514029 32453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:40.506890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59125 (local address 127.0.0.1:34707)
0808 02:43:40.507813 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:40.507827 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:40.507873 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:43:40.509729 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:40.509759 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:40.510194 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:40.510683 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:40.511907 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:40.511913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:40.511928 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:40.511942 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:40.512001 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:40.512022 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:40.512339 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:40.512533 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 02:43:40.512755 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":420,"threads_started":1}
I20260808 02:43:40.515062 32450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a: Bootstrap starting.
I20260808 02:43:40.518586 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:40.518919 32450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:40.520090 32450 log.cc:824] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:40.524134 32450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a: No bootstrap required, opened a new log
I20260808 02:43:40.527073 32453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:40.524087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50945 (local address 127.0.0.1:34707)
0808 02:43:40.524319 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:40.524326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:40.524619 (+ 293us) server_negotiation.cc:407] Connection header received
0808 02:43:40.524853 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:40.524857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:40.524919 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:40.525033 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:40.526260 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:40.526268 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:40.526271 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:40.526293 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:40.526351 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:40.526369 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:40.526516 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:40.526659 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 02:43:40.526775 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 02:43:40.534668 32450 raft_consensus.cc:348] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260808 02:43:40.535427 32450 raft_consensus.cc:374] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:40.535586 32450 raft_consensus.cc:729] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e452ecd79bff41c89ed7c6c05ee4403a, State: Initialized, Role: FOLLOWER
I20260808 02:43:40.536316 32450 consensus_queue.cc:260] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260808 02:43:40.536597 32450 raft_consensus.cc:388] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:40.536749 32450 raft_consensus.cc:482] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:40.536966 32450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:40.540014 32450 raft_consensus.cc:504] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260808 02:43:40.540815 32450 leader_election.cc:302] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e452ecd79bff41c89ed7c6c05ee4403a; no voters:
I20260808 02:43:40.541906 32450 leader_election.cc:288] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:40.542138 32461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:40.543488 32461 raft_consensus.cc:686] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [term 1 LEADER]: Becoming Leader. State: Replica: e452ecd79bff41c89ed7c6c05ee4403a, State: Running, Role: LEADER
I20260808 02:43:40.544441 32461 consensus_queue.cc:237] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260808 02:43:40.544950 32450 sys_catalog.cc:564] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:40.549346 32462 sys_catalog.cc:455] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } } }
I20260808 02:43:40.549252 32463 sys_catalog.cc:455] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e452ecd79bff41c89ed7c6c05ee4403a. Latest consensus state: current_term: 1 leader_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e452ecd79bff41c89ed7c6c05ee4403a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } } }
I20260808 02:43:40.549907 32462 sys_catalog.cc:458] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:40.549939 32463 sys_catalog.cc:458] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:40.551448 32470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:40.560074 32470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:40.573586 32470 catalog_manager.cc:1347] Generated new cluster ID: f887521ecc3242a69e04b4dfc2467fca
I20260808 02:43:40.573750 32470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:40.598325 32470 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:40.599025 32470 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:40.611289 32470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e452ecd79bff41c89ed7c6c05ee4403a: Generated new TSK 0
I20260808 02:43:40.612622 32470 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:40.633160 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32381
W20260808 02:43:40.635171 32445 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59125
W20260808 02:43:40.636302 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32381: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:40.636520 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32381
2026-08-08T02:43:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:40 dist-test-slave-8tdl krb5kdc[32483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:40 dist-test-slave-8tdl krb5kdc[32483](info): set up 2 sockets
Aug 08 02:43:40 dist-test-slave-8tdl krb5kdc[32483](info): commencing operation
krb5kdc: starting...
W20260808 02:43:41.920992 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.003s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:42 dist-test-slave-8tdl krb5kdc[32483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:42.317152 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45287
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:42.700991 32496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:42.701375 32496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:42.701589 32496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:42.709522 32496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:42.709673 32496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:42.709772 32496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:42.709900 32496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:42.709985 32496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:42.721022 32496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:42.722488 32496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:42.723941 32496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:42.737267 32502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:42.737598 32504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:42.737974 32501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:42.739337 32496 server_base.cc:1034] running on GCE node
I20260808 02:43:42.740408 32496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:42.742103 32496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:42.743372 32496 hybrid_clock.cc:648] HybridClock initialized: now 1786157022743324 us; error 44 us; skew 500 ppm
I20260808 02:43:42.743806 32496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:42 dist-test-slave-8tdl krb5kdc[32483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157022, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:42.747702 32496 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:42.749609 32496 webserver.cc:460] Webserver started at http://127.0.0.1:41097/ using document root <none> and password file <none>
I20260808 02:43:42.750396 32496 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:42.750571 32496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:42.750990 32496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:42.754447 32496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "7f6c261066024298a2df6f729a50fd32"
format_stamp: "Formatted at 2026-08-08 02:43:42 on dist-test-slave-8tdl"
server_key: "29009f6cc685726f90a50077904544eb"
server_key_iv: "b569f5c2a9273d33b4a03a6e1f69c0d4"
server_key_version: "encryptionkey@0"
I20260808 02:43:42.755532 32496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "7f6c261066024298a2df6f729a50fd32"
format_stamp: "Formatted at 2026-08-08 02:43:42 on dist-test-slave-8tdl"
server_key: "29009f6cc685726f90a50077904544eb"
server_key_iv: "b569f5c2a9273d33b4a03a6e1f69c0d4"
server_key_version: "encryptionkey@0"
I20260808 02:43:42.761713 32496 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260808 02:43:42.766229 32512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:42.768483 32496 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:42.768759 32496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "7f6c261066024298a2df6f729a50fd32"
format_stamp: "Formatted at 2026-08-08 02:43:42 on dist-test-slave-8tdl"
server_key: "29009f6cc685726f90a50077904544eb"
server_key_iv: "b569f5c2a9273d33b4a03a6e1f69c0d4"
server_key_version: "encryptionkey@0"
I20260808 02:43:42.769111 32496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:42.795539 32496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:42.801224 32496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:42.801615 32496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:42.825949 32496 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45287
I20260808 02:43:42.825999 32565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45287 every 8 connection(s)
I20260808 02:43:42.827885 32496 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:42.828353 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32496
I20260808 02:43:42.828575 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:42.829273 10321 external_mini_cluster.cc:1428] Setting key 032ab546ecaf5845ba8f2a5dba6f6ec1
I20260808 02:43:42.833742 32566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:43:42 dist-test-slave-8tdl krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:43:42.850652 32566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32: Bootstrap starting.
I20260808 02:43:42.854771 32566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:42.856160 32566 log.cc:824] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:42.858875 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:42.831530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:35615 (local address 127.0.0.1:45287)
0808 02:43:42.832419 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:42.832433 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:42.832478 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:43:42.834370 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:42.834396 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:42.834991 (+ 595us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:42.835371 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:42.837701 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:42.839410 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:42.841726 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:42.842766 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:42.842964 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:42.849669 (+ 6705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:42.849693 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:42.849716 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:42.849782 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:42.853608 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:42.854809 (+ 1201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:42.854819 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:42.854826 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:42.855098 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:42.855660 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:42.855664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:42.855666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:42.856316 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:42.856693 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:42.857255 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 02:43:42.857661 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":423,"threads_started":1}
I20260808 02:43:42.859815 32566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32: No bootstrap required, opened a new log
I20260808 02:43:42.863811 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:42.869484 32566 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6c261066024298a2df6f729a50fd32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45287 } }
I20260808 02:43:42.870074 32566 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:42.870221 32566 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6c261066024298a2df6f729a50fd32, State: Initialized, Role: FOLLOWER
I20260808 02:43:42.871040 32566 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6c261066024298a2df6f729a50fd32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45287 } }
I20260808 02:43:42.871371 32566 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:42.871536 32566 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:42.871759 32566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:42.875483 32566 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6c261066024298a2df6f729a50fd32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45287 } }
I20260808 02:43:42.876189 32566 leader_election.cc:302] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f6c261066024298a2df6f729a50fd32; no voters:
I20260808 02:43:42.876964 32566 leader_election.cc:288] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:42.877185 32576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:42.879179 32576 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [term 1 LEADER]: Becoming Leader. State: Replica: 7f6c261066024298a2df6f729a50fd32, State: Running, Role: LEADER
I20260808 02:43:42.879901 32576 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6c261066024298a2df6f729a50fd32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45287 } }
I20260808 02:43:42.880338 32566 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:42.883860 32578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f6c261066024298a2df6f729a50fd32. Latest consensus state: current_term: 1 leader_uuid: "7f6c261066024298a2df6f729a50fd32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6c261066024298a2df6f729a50fd32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45287 } } }
I20260808 02:43:42.884382 32578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:42.885003 32577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f6c261066024298a2df6f729a50fd32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6c261066024298a2df6f729a50fd32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45287 } } }
I20260808 02:43:42.885403 32577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:42.889395 32583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:42.892784 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:42.869159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:52401 (local address 127.0.0.1:45287)
0808 02:43:42.869454 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:42.869471 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:42.869924 (+ 453us) server_negotiation.cc:407] Connection header received
0808 02:43:42.870224 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:42.870229 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:42.870321 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:42.870458 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:42.872731 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:42.873703 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:42.875867 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:42.876575 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:42.876765 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:42.880659 (+ 3894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:42.880666 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:42.880671 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:42.880722 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:42.887657 (+ 6935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:42.889168 (+ 1511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:42.889177 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:42.889183 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:42.889456 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:42.890234 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:42.890242 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:42.890249 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:42.891007 (+ 758us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:42.891470 (+ 463us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:42.891942 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 02:43:42.892229 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 02:43:42.897935 32583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:42.901739 32593 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 02:43:42.909561 32583 catalog_manager.cc:1347] Generated new cluster ID: e1b25cbec0b74b9ea657cd541911c729
I20260808 02:43:42.909732 32583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:42.957198 32583 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:42.959162 32583 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:42.977262 32583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f6c261066024298a2df6f729a50fd32: Generated new TSK 0
I20260808 02:43:42.978315 32583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:42.987226 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32496
I20260808 02:43:42.988917 32561 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:43.089226 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32496
W20260808 02:43:43.111788 32480 connection.cc:535] client connection to 127.0.0.1:45287 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45287): Connection reset by peer (error 104)
2026-08-08T02:43:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2448 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:43 dist-test-slave-8tdl krb5kdc[32598](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:43 dist-test-slave-8tdl krb5kdc[32598](info): set up 2 sockets
Aug 08 02:43:43 dist-test-slave-8tdl krb5kdc[32598](info): commencing operation
krb5kdc: starting...
W20260808 02:43:44.343077 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.004s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:44 dist-test-slave-8tdl krb5kdc[32598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:44.759981 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45377
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:45.148895 32612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:45.149303 32612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:45.149490 32612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:45.157135 32612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:45.157337 32612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:45.157466 32612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:45.157582 32612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:45.157672 32612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:45.168560 32612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:45.170064 32612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:45.171494 32612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:45.186102 32618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:45.186120 32617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:45.186990 32620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:45.187779 32612 server_base.cc:1034] running on GCE node
I20260808 02:43:45.188787 32612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:45.190469 32612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:45.191774 32612 hybrid_clock.cc:648] HybridClock initialized: now 1786157025191717 us; error 70 us; skew 500 ppm
I20260808 02:43:45.192287 32612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:45 dist-test-slave-8tdl krb5kdc[32598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157025, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:45.196252 32612 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:45.198045 32612 webserver.cc:460] Webserver started at http://127.0.0.1:41737/ using document root <none> and password file <none>
I20260808 02:43:45.198896 32612 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:45.199059 32612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:45.199524 32612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:45.203178 32612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "f856ad58dcaa4f748108e1a98dd25c6c"
format_stamp: "Formatted at 2026-08-08 02:43:45 on dist-test-slave-8tdl"
server_key: "915a21120c291770a82e28ef3b5ca59f"
server_key_iv: "7ccd47ac003dc74528bbda435c30991a"
server_key_version: "encryptionkey@0"
I20260808 02:43:45.204113 32612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "f856ad58dcaa4f748108e1a98dd25c6c"
format_stamp: "Formatted at 2026-08-08 02:43:45 on dist-test-slave-8tdl"
server_key: "915a21120c291770a82e28ef3b5ca59f"
server_key_iv: "7ccd47ac003dc74528bbda435c30991a"
server_key_version: "encryptionkey@0"
I20260808 02:43:45.210813 32612 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:43:45.215587 32627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:45.217232 32612 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 02:43:45.217496 32612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "f856ad58dcaa4f748108e1a98dd25c6c"
format_stamp: "Formatted at 2026-08-08 02:43:45 on dist-test-slave-8tdl"
server_key: "915a21120c291770a82e28ef3b5ca59f"
server_key_iv: "7ccd47ac003dc74528bbda435c30991a"
server_key_version: "encryptionkey@0"
I20260808 02:43:45.217763 32612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:45.238623 32612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:45.244750 32612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:45.245137 32612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:45.266219 32612 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45377
I20260808 02:43:45.266316 32686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45377 every 8 connection(s)
I20260808 02:43:45.267786 32612 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:45.271937 32687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:45.272217 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32612
I20260808 02:43:45.272403 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:45.272877 10321 external_mini_cluster.cc:1428] Setting key bb700b3826033d5a820402c511768fb5
I20260808 02:43:45.288887 32687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c: Bootstrap starting.
I20260808 02:43:45.289888 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:45.275124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:47727 (local address 127.0.0.1:45377)
0808 02:43:45.275968 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:45.275984 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:45.276040 (+ 56us) server_negotiation.cc:407] Connection header received
0808 02:43:45.277779 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:45.277815 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:45.278426 (+ 611us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:45.279012 (+ 586us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:45.279642 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:45.281754 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:45.283758 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:45.284939 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:45.285154 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:45.286610 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:45.286621 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:45.286645 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:45.287477 (+ 832us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:45.287598 (+ 121us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:45.287633 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:45.287796 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:45.288187 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 02:43:45.288397 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":350,"threads_started":1}
I20260808 02:43:45.293048 32687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:45.294353 32687 log.cc:824] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:45.294934 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:45.297850 32687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c: No bootstrap required, opened a new log
I20260808 02:43:45.306746 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:45.300148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:43701 (local address 127.0.0.1:45377)
0808 02:43:45.300354 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:45.300363 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:45.300790 (+ 427us) server_negotiation.cc:407] Connection header received
0808 02:43:45.301036 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:45.301040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:45.301113 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:45.301242 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:45.301768 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:45.302572 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:45.303969 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:45.304490 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:45.304658 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:45.305913 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:45.305917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:45.305921 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:45.305943 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:45.305991 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:45.306010 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:45.306152 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:45.306347 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 02:43:45.306407 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 02:43:45.307068 32687 raft_consensus.cc:348] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45377 } }
I20260808 02:43:45.307552 32687 raft_consensus.cc:374] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:45.307679 32687 raft_consensus.cc:729] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f856ad58dcaa4f748108e1a98dd25c6c, State: Initialized, Role: FOLLOWER
I20260808 02:43:45.308351 32687 consensus_queue.cc:260] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45377 } }
I20260808 02:43:45.308660 32687 raft_consensus.cc:388] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:45.308797 32687 raft_consensus.cc:482] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:45.308943 32687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:45.311403 32687 raft_consensus.cc:504] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45377 } }
I20260808 02:43:45.311964 32687 leader_election.cc:302] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f856ad58dcaa4f748108e1a98dd25c6c; no voters:
I20260808 02:43:45.312610 32687 leader_election.cc:288] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:45.312791 32697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:45.313565 32697 raft_consensus.cc:686] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [term 1 LEADER]: Becoming Leader. State: Replica: f856ad58dcaa4f748108e1a98dd25c6c, State: Running, Role: LEADER
I20260808 02:43:45.314245 32697 consensus_queue.cc:237] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45377 } }
I20260808 02:43:45.315130 32687 sys_catalog.cc:564] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:45.317677 32698 sys_catalog.cc:455] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45377 } } }
I20260808 02:43:45.317649 32699 sys_catalog.cc:455] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f856ad58dcaa4f748108e1a98dd25c6c. Latest consensus state: current_term: 1 leader_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f856ad58dcaa4f748108e1a98dd25c6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45377 } } }
I20260808 02:43:45.318236 32698 sys_catalog.cc:458] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:45.318261 32699 sys_catalog.cc:458] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:45.320324 32704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:45.326565 32704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:45.336961 32704 catalog_manager.cc:1347] Generated new cluster ID: 7ff535553be5496f9249974734f1f2de
I20260808 02:43:45.337109 32704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:45.366009 32704 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:45.368182 32704 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:45.379429 32704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f856ad58dcaa4f748108e1a98dd25c6c: Generated new TSK 0
I20260808 02:43:45.380586 32704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:45.396281 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32612
W20260808 02:43:45.397647 32681 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.51:47727
W20260808 02:43:45.398593 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32612: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:45.398788 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32612
W20260808 02:43:45.420128 32596 connection.cc:535] client connection to 127.0.0.1:45377 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45377): Connection reset by peer (error 104)
2026-08-08T02:43:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2307 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:45 dist-test-slave-8tdl krb5kdc[32719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:45 dist-test-slave-8tdl krb5kdc[32719](info): set up 2 sockets
Aug 08 02:43:45 dist-test-slave-8tdl krb5kdc[32719](info): commencing operation
krb5kdc: starting...
W20260808 02:43:46.631641 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:46 dist-test-slave-8tdl krb5kdc[32719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:47.032397 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35695
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:47.419392 32732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:47.419947 32732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:47.420130 32732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:47.428333 32732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:47.428498 32732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:47.428582 32732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:47.428680 32732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:47.428778 32732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:47.440174 32732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:47.441651 32732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:47.443204 32732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:47.456342 32739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:47.456424 32741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:47.456496 32738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:47.457978 32732 server_base.cc:1034] running on GCE node
I20260808 02:43:47.458997 32732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:47.460744 32732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:47.462071 32732 hybrid_clock.cc:648] HybridClock initialized: now 1786157027461953 us; error 114 us; skew 500 ppm
I20260808 02:43:47.462523 32732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:47 dist-test-slave-8tdl krb5kdc[32719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157027, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:47.466128 32732 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:47.467967 32732 webserver.cc:460] Webserver started at http://127.0.0.1:35323/ using document root <none> and password file <none>
I20260808 02:43:47.468948 32732 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:47.469092 32732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:47.469372 32732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:47.472810 32732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "6df5f0712e794b1fbd7e3bc1f223dac9"
format_stamp: "Formatted at 2026-08-08 02:43:47 on dist-test-slave-8tdl"
server_key: "9e5ece08f39b230d2f752a1de362c651"
server_key_iv: "a8e1b5324fdc1c69a3ded7d2eab963be"
server_key_version: "encryptionkey@0"
I20260808 02:43:47.473711 32732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "6df5f0712e794b1fbd7e3bc1f223dac9"
format_stamp: "Formatted at 2026-08-08 02:43:47 on dist-test-slave-8tdl"
server_key: "9e5ece08f39b230d2f752a1de362c651"
server_key_iv: "a8e1b5324fdc1c69a3ded7d2eab963be"
server_key_version: "encryptionkey@0"
I20260808 02:43:47.479887 32732 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:43:47.484786 32748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:47.486532 32732 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 02:43:47.486791 32732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "6df5f0712e794b1fbd7e3bc1f223dac9"
format_stamp: "Formatted at 2026-08-08 02:43:47 on dist-test-slave-8tdl"
server_key: "9e5ece08f39b230d2f752a1de362c651"
server_key_iv: "a8e1b5324fdc1c69a3ded7d2eab963be"
server_key_version: "encryptionkey@0"
I20260808 02:43:47.487021 32732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:47.493852 32732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:47.498925 32732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:47.499300 32732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:47.520563 32732 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35695
I20260808 02:43:47.520628 335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35695 every 8 connection(s)
I20260808 02:43:47.522157 32732 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:47.524186 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 32732
I20260808 02:43:47.524435 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:47.524987 10321 external_mini_cluster.cc:1428] Setting key b474e422d9b10927055f0037c948ec7b
I20260808 02:43:47.527083 336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:47.535029 339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:47.527157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:56697 (local address 127.0.0.1:35695)
0808 02:43:47.528066 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:47.528082 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:47.528138 (+ 56us) server_negotiation.cc:407] Connection header received
0808 02:43:47.530450 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:47.530481 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:47.531059 (+ 578us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:47.531567 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:47.532787 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:47.532797 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:47.532814 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:47.532836 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:47.532938 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:47.532979 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:47.533229 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:47.533363 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 02:43:47.533610 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":358,"threads_started":1}
I20260808 02:43:47.539546 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:47.542121 336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9: Bootstrap starting.
I20260808 02:43:47.546150 336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:47.547431 336 log.cc:824] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:47.547773 339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:47.544785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:38477 (local address 127.0.0.1:35695)
0808 02:43:47.545008 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:47.545016 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:47.545461 (+ 445us) server_negotiation.cc:407] Connection header received
0808 02:43:47.545687 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:47.545692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:47.545742 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:47.545940 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:47.546987 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:47.546993 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:47.546998 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:47.547025 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:47.547070 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:47.547085 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:47.547219 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:47.547316 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 02:43:47.547386 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 02:43:47.551014 336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9: No bootstrap required, opened a new log
I20260808 02:43:47.559499 336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35695 } }
I20260808 02:43:47.560137 336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:47.560290 336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df5f0712e794b1fbd7e3bc1f223dac9, State: Initialized, Role: FOLLOWER
I20260808 02:43:47.561069 336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35695 } }
I20260808 02:43:47.561363 336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:47.561548 336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:47.561761 336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:47.564538 336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35695 } }
I20260808 02:43:47.565291 336 leader_election.cc:302] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6df5f0712e794b1fbd7e3bc1f223dac9; no voters:
I20260808 02:43:47.566170 336 leader_election.cc:288] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:47.566390 346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:47.567754 346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [term 1 LEADER]: Becoming Leader. State: Replica: 6df5f0712e794b1fbd7e3bc1f223dac9, State: Running, Role: LEADER
I20260808 02:43:47.568380 346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35695 } }
I20260808 02:43:47.569311 336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:47.571890 348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35695 } } }
I20260808 02:43:47.572453 348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:47.572268 349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6df5f0712e794b1fbd7e3bc1f223dac9. Latest consensus state: current_term: 1 leader_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6df5f0712e794b1fbd7e3bc1f223dac9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35695 } } }
I20260808 02:43:47.572609 349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:47.573771 357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:47.583163 357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:47.593809 357 catalog_manager.cc:1347] Generated new cluster ID: a7602cfca55545abb5cb4b349adc14ac
I20260808 02:43:47.593992 357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:47.631127 357 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:47.631745 357 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:47.640646 357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6df5f0712e794b1fbd7e3bc1f223dac9: Generated new TSK 0
I20260808 02:43:47.641777 357 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:47.660686 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32732
W20260808 02:43:47.662765 331 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.51:56697
W20260808 02:43:47.663753 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 32732: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:47.664053 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 32732
2026-08-08T02:43:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2266 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:47 dist-test-slave-8tdl krb5kdc[369](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:47 dist-test-slave-8tdl krb5kdc[369](info): set up 2 sockets
Aug 08 02:43:47 dist-test-slave-8tdl krb5kdc[369](info): commencing operation
krb5kdc: starting...
W20260808 02:43:48.948611 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:49 dist-test-slave-8tdl krb5kdc[369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:49.367635 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46611
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:49.787410 382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:49.787982 382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:49.788194 382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:49.799719 382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:49.799880 382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:49.799990 382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:49.800127 382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:49.800200 382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:49.813225 382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46611
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:49.815330 382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:49.817291 382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:49.833108 390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:49.833199 387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:49.833129 388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:49.837666 382 server_base.cc:1034] running on GCE node
I20260808 02:43:49.838886 382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:49.840874 382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:49.842315 382 hybrid_clock.cc:648] HybridClock initialized: now 1786157029842269 us; error 122 us; skew 500 ppm
I20260808 02:43:49.843156 382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:49 dist-test-slave-8tdl krb5kdc[369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157029, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:49.850466 382 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:49.853096 382 webserver.cc:460] Webserver started at http://127.0.0.1:41439/ using document root <none> and password file <none>
I20260808 02:43:49.854027 382 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:49.854218 382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:49.854583 382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:49.859017 382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec"
format_stamp: "Formatted at 2026-08-08 02:43:49 on dist-test-slave-8tdl"
server_key: "49d4dfebc3dd929090306594d8224977"
server_key_iv: "c370c2048ede2ceffee8db1da4615eb0"
server_key_version: "encryptionkey@0"
I20260808 02:43:49.860106 382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec"
format_stamp: "Formatted at 2026-08-08 02:43:49 on dist-test-slave-8tdl"
server_key: "49d4dfebc3dd929090306594d8224977"
server_key_iv: "c370c2048ede2ceffee8db1da4615eb0"
server_key_version: "encryptionkey@0"
I20260808 02:43:49.867306 382 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.003s
I20260808 02:43:49.872036 397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:49.874044 382 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260808 02:43:49.874315 382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec"
format_stamp: "Formatted at 2026-08-08 02:43:49 on dist-test-slave-8tdl"
server_key: "49d4dfebc3dd929090306594d8224977"
server_key_iv: "c370c2048ede2ceffee8db1da4615eb0"
server_key_version: "encryptionkey@0"
I20260808 02:43:49.874573 382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:49.892578 382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:49.898955 382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:49.899353 382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:49.923565 382 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46611
I20260808 02:43:49.923566 451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46611 every 8 connection(s)
I20260808 02:43:49.925617 382 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:49.931149 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 382
I20260808 02:43:49.931377 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:49.931595 452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:49.931906 10321 external_mini_cluster.cc:1428] Setting key 63fef5c1e9f7b8baba1a4fbef208635d
I20260808 02:43:49.949704 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec: Bootstrap starting.
Aug 08 02:43:49 dist-test-slave-8tdl krb5kdc[369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 02:43:49.954437 452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:49.956221 452 log.cc:824] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:49.960894 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec: No bootstrap required, opened a new log
I20260808 02:43:49.963424 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:49.933912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:59077 (local address 127.0.0.1:46611)
0808 02:43:49.934894 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:49.934911 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:49.934968 (+ 57us) server_negotiation.cc:407] Connection header received
0808 02:43:49.937198 (+ 2230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:49.937231 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:49.937893 (+ 662us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:49.938453 (+ 560us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:49.941188 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:49.942606 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:49.944931 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:49.945856 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:49.946044 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:49.952431 (+ 6387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:49.952445 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:49.952467 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:49.952530 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:49.957450 (+ 4920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:49.958596 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:49.958606 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:49.958618 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:49.958904 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:49.959634 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:49.959641 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:49.959645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:49.960553 (+ 908us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:49.960997 (+ 444us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:49.961519 (+ 522us) server_negotiation.cc:299] Negotiation successful
0808 02:43:49.961934 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":437,"threads_started":1}
I20260808 02:43:49.968375 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:49.972648 452 raft_consensus.cc:348] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46611 } }
I20260808 02:43:49.973363 452 raft_consensus.cc:374] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:49.973510 452 raft_consensus.cc:729] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09c63a4a17e4eb1af6a27c1c9c976ec, State: Initialized, Role: FOLLOWER
I20260808 02:43:49.974371 452 consensus_queue.cc:260] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46611 } }
I20260808 02:43:49.974822 452 raft_consensus.cc:388] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:49.974996 452 raft_consensus.cc:482] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:49.975250 452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:49.978459 452 raft_consensus.cc:504] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46611 } }
I20260808 02:43:49.979261 452 leader_election.cc:302] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a09c63a4a17e4eb1af6a27c1c9c976ec; no voters:
I20260808 02:43:49.980127 452 leader_election.cc:288] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:49.980316 462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:49.981607 462 raft_consensus.cc:686] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [term 1 LEADER]: Becoming Leader. State: Replica: a09c63a4a17e4eb1af6a27c1c9c976ec, State: Running, Role: LEADER
I20260808 02:43:49.982407 462 consensus_queue.cc:237] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46611 } }
I20260808 02:43:49.982962 452 sys_catalog.cc:564] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:49.986433 463 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46611 } } }
I20260808 02:43:49.986722 464 sys_catalog.cc:455] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader a09c63a4a17e4eb1af6a27c1c9c976ec. Latest consensus state: current_term: 1 leader_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a09c63a4a17e4eb1af6a27c1c9c976ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46611 } } }
I20260808 02:43:49.986985 463 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:49.987020 464 sys_catalog.cc:458] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:49.988612 467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:49.995042 467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:50.004278 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:49.975379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:57643 (local address 127.0.0.1:46611)
0808 02:43:49.975610 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:49.975623 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:49.976258 (+ 635us) server_negotiation.cc:407] Connection header received
0808 02:43:49.976448 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:49.976453 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:49.976556 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:49.976694 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:49.978995 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:49.979997 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:49.982001 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:49.982602 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:49.982815 (+ 213us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:49.989202 (+ 6387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:49.989214 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:49.989222 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:49.989287 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:49.994629 (+ 5342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:49.996391 (+ 1762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:49.996403 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:49.996410 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:49.996654 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:49.997568 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:49.997578 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:49.997585 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:49.998287 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:50.002419 (+ 4132us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:50.002832 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 02:43:50.003428 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 02:43:50.009580 467 catalog_manager.cc:1347] Generated new cluster ID: 91b6ea588d194123b5788493f1f37d46
I20260808 02:43:50.009835 467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:50.033831 467 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:50.035441 467 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:50.047995 467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a09c63a4a17e4eb1af6a27c1c9c976ec: Generated new TSK 0
I20260808 02:43:50.049115 467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:50.066917 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 382
I20260808 02:43:50.068339 447 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:50.170578 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 382
W20260808 02:43:50.190858 367 connection.cc:535] client connection to 127.0.0.1:46611 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46611): Connection reset by peer (error 104)
2026-08-08T02:43:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2504 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:50 dist-test-slave-8tdl krb5kdc[485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:50 dist-test-slave-8tdl krb5kdc[485](info): set up 2 sockets
Aug 08 02:43:50 dist-test-slave-8tdl krb5kdc[485](info): commencing operation
krb5kdc: starting...
W20260808 02:43:51.449041 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.012s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:51 dist-test-slave-8tdl krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:51.880182 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39045
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:52.280920 498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:52.281354 498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:52.281549 498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:52.289698 498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:52.289903 498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:52.290028 498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:52.290148 498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:52.290228 498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:52.301519 498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39045
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:52.303062 498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:52.304543 498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:52.318514 504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:52.318444 507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:52.318522 503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:52.319697 498 server_base.cc:1034] running on GCE node
I20260808 02:43:52.320770 498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:52.322628 498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:52.324000 498 hybrid_clock.cc:648] HybridClock initialized: now 1786157032323982 us; error 68 us; skew 500 ppm
I20260808 02:43:52.324443 498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:52 dist-test-slave-8tdl krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157032, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:52.328246 498 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:52.330139 498 webserver.cc:460] Webserver started at http://127.0.0.1:46167/ using document root <none> and password file <none>
I20260808 02:43:52.331022 498 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:52.331156 498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:52.331432 498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:52.334860 498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "4f0416bac1bd4e059b6040122fecbc25"
format_stamp: "Formatted at 2026-08-08 02:43:52 on dist-test-slave-8tdl"
server_key: "f3fcf5a89b8ad2b1f02ff8915713dd79"
server_key_iv: "7136644929bffd46a7ac7939cf208be0"
server_key_version: "encryptionkey@0"
I20260808 02:43:52.335734 498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "4f0416bac1bd4e059b6040122fecbc25"
format_stamp: "Formatted at 2026-08-08 02:43:52 on dist-test-slave-8tdl"
server_key: "f3fcf5a89b8ad2b1f02ff8915713dd79"
server_key_iv: "7136644929bffd46a7ac7939cf208be0"
server_key_version: "encryptionkey@0"
I20260808 02:43:52.341862 498 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:43:52.346606 514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:52.348587 498 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:52.349025 498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "4f0416bac1bd4e059b6040122fecbc25"
format_stamp: "Formatted at 2026-08-08 02:43:52 on dist-test-slave-8tdl"
server_key: "f3fcf5a89b8ad2b1f02ff8915713dd79"
server_key_iv: "7136644929bffd46a7ac7939cf208be0"
server_key_version: "encryptionkey@0"
I20260808 02:43:52.349306 498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:52.372957 498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:52.378654 498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:52.379223 498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:52.402374 498 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39045
I20260808 02:43:52.402415 568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39045 every 8 connection(s)
I20260808 02:43:52.404116 498 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:52.405907 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 498
I20260808 02:43:52.406087 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:52.406625 10321 external_mini_cluster.cc:1428] Setting key d9d6df82b1a0f89bda05d2bb7d39f753
I20260808 02:43:52.409781 569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:52.424651 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:52.408854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:42121 (local address 127.0.0.1:39045)
0808 02:43:52.409869 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:52.409883 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:52.409929 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:43:52.412129 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:52.412157 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:52.412656 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:52.413114 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:52.413970 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:52.415994 (+ 2024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:52.418318 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:52.419504 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:52.419675 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:52.421492 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:52.421501 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:52.421520 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:52.422271 (+ 751us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:52.422374 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:52.422411 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:52.422616 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:52.423174 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 02:43:52.423439 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":469,"threads_started":1}
I20260808 02:43:52.425863 569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25: Bootstrap starting.
I20260808 02:43:52.429801 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:52.430182 569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:52.431491 569 log.cc:824] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:52.435633 569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25: No bootstrap required, opened a new log
I20260808 02:43:52.443002 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:52.435048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:41803 (local address 127.0.0.1:39045)
0808 02:43:52.435266 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:52.435274 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:52.435721 (+ 447us) server_negotiation.cc:407] Connection header received
0808 02:43:52.436061 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:52.436065 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:52.436136 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:52.436264 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:52.436855 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:52.437897 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:52.439627 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:52.440175 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:52.440373 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:52.441796 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:52.441802 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:52.441806 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:52.441832 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:52.441882 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:52.441900 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:52.442091 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:52.442288 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 02:43:52.442356 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 02:43:52.445187 569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f0416bac1bd4e059b6040122fecbc25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39045 } }
I20260808 02:43:52.445672 569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:52.445791 569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f0416bac1bd4e059b6040122fecbc25, State: Initialized, Role: FOLLOWER
I20260808 02:43:52.446475 569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f0416bac1bd4e059b6040122fecbc25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39045 } }
I20260808 02:43:52.446770 569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:52.446943 569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:52.447149 569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:52.449895 569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f0416bac1bd4e059b6040122fecbc25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39045 } }
I20260808 02:43:52.450944 569 leader_election.cc:302] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f0416bac1bd4e059b6040122fecbc25; no voters:
I20260808 02:43:52.451771 569 leader_election.cc:288] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:52.452004 580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:52.453064 580 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [term 1 LEADER]: Becoming Leader. State: Replica: 4f0416bac1bd4e059b6040122fecbc25, State: Running, Role: LEADER
I20260808 02:43:52.453900 580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f0416bac1bd4e059b6040122fecbc25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39045 } }
I20260808 02:43:52.454631 569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:52.457543 582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f0416bac1bd4e059b6040122fecbc25. Latest consensus state: current_term: 1 leader_uuid: "4f0416bac1bd4e059b6040122fecbc25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f0416bac1bd4e059b6040122fecbc25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39045 } } }
I20260808 02:43:52.457670 581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f0416bac1bd4e059b6040122fecbc25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f0416bac1bd4e059b6040122fecbc25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39045 } } }
I20260808 02:43:52.458047 582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:52.458134 581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:52.460740 587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:52.467885 587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:52.479673 587 catalog_manager.cc:1347] Generated new cluster ID: 7ba61d2a57f74064bd632db05ab4ef9a
I20260808 02:43:52.479879 587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:52.501772 587 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:52.503690 587 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:52.512696 587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f0416bac1bd4e059b6040122fecbc25: Generated new TSK 0
I20260808 02:43:52.513754 587 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:52.528852 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 498
W20260808 02:43:52.530612 564 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.51:42121
W20260808 02:43:52.531709 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 498: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:52.531934 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 498
W20260808 02:43:52.555430 483 connection.cc:535] client connection to 127.0.0.1:39045 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39045): Connection reset by peer (error 104)
2026-08-08T02:43:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2363 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:52 dist-test-slave-8tdl krb5kdc[603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:52 dist-test-slave-8tdl krb5kdc[603](info): set up 2 sockets
Aug 08 02:43:52 dist-test-slave-8tdl krb5kdc[603](info): commencing operation
krb5kdc: starting...
W20260808 02:43:53.790436 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.000s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:54 dist-test-slave-8tdl krb5kdc[603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 02:43:54.231029 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38657
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:54.610807 616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:54.611142 616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:54.611239 616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:54.619944 616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:54.620087 616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:54.620138 616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:54.620203 616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:54.620249 616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:54.631243 616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38657
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:54.632660 616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:54.634016 616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:54.648938 622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:54.649065 625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:54.649394 621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:54.650081 616 server_base.cc:1034] running on GCE node
I20260808 02:43:54.651153 616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:54.652884 616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:54.654213 616 hybrid_clock.cc:648] HybridClock initialized: now 1786157034654162 us; error 68 us; skew 500 ppm
I20260808 02:43:54.654636 616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:54 dist-test-slave-8tdl krb5kdc[603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157034, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:54.658427 616 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 02:43:54.660408 616 webserver.cc:460] Webserver started at http://127.0.0.1:34457/ using document root <none> and password file <none>
I20260808 02:43:54.661204 616 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:54.661376 616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:54.661728 616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:54.665216 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "3feb3b2092fd482b8c4d67366dd3a940"
format_stamp: "Formatted at 2026-08-08 02:43:54 on dist-test-slave-8tdl"
server_key: "f147bf02adaf0a260717c1e1fd5ccae0"
server_key_iv: "4c8fcde9d010356d0a4db813ea2a2f48"
server_key_version: "encryptionkey@0"
I20260808 02:43:54.666162 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "3feb3b2092fd482b8c4d67366dd3a940"
format_stamp: "Formatted at 2026-08-08 02:43:54 on dist-test-slave-8tdl"
server_key: "f147bf02adaf0a260717c1e1fd5ccae0"
server_key_iv: "4c8fcde9d010356d0a4db813ea2a2f48"
server_key_version: "encryptionkey@0"
I20260808 02:43:54.672657 616 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 02:43:54.676980 632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:54.678954 616 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:54.679180 616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "3feb3b2092fd482b8c4d67366dd3a940"
format_stamp: "Formatted at 2026-08-08 02:43:54 on dist-test-slave-8tdl"
server_key: "f147bf02adaf0a260717c1e1fd5ccae0"
server_key_iv: "4c8fcde9d010356d0a4db813ea2a2f48"
server_key_version: "encryptionkey@0"
I20260808 02:43:54.679435 616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:54.686889 616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:54.692341 616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:54.692744 616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:54.715694 616 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38657
I20260808 02:43:54.715754 687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38657 every 8 connection(s)
I20260808 02:43:54.717799 616 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:54.721207 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 616
I20260808 02:43:54.721421 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:54.722003 10321 external_mini_cluster.cc:1428] Setting key db6d95288785200c2d3debcbd776e0ca
I20260808 02:43:54.722823 688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:54.730590 691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:54.724117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:53907 (local address 127.0.0.1:38657)
0808 02:43:54.725002 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:54.725014 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:54.725059 (+ 45us) server_negotiation.cc:407] Connection header received
0808 02:43:54.726659 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:54.726742 (+ 83us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:54.727162 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:54.727573 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:54.728759 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:54.728766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:54.728780 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:54.728801 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:54.728887 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:54.728911 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:54.729106 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:54.729212 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 02:43:54.729500 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":402,"threads_started":1}
I20260808 02:43:54.735801 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:54.739701 688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940: Bootstrap starting.
I20260808 02:43:54.744868 688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:54.745922 691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:54.742662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:56813 (local address 127.0.0.1:38657)
0808 02:43:54.742872 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:54.742877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:54.743279 (+ 402us) server_negotiation.cc:407] Connection header received
0808 02:43:54.743516 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:54.743520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:54.743579 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:54.743670 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:54.745041 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:54.745051 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:54.745058 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:54.745089 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:54.745145 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:54.745168 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:54.745281 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:54.745491 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 02:43:54.745575 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 02:43:54.746482 688 log.cc:824] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:54.750372 688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940: No bootstrap required, opened a new log
I20260808 02:43:54.759090 688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3feb3b2092fd482b8c4d67366dd3a940" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38657 } }
I20260808 02:43:54.759521 688 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:54.759608 688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3feb3b2092fd482b8c4d67366dd3a940, State: Initialized, Role: FOLLOWER
I20260808 02:43:54.760177 688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3feb3b2092fd482b8c4d67366dd3a940" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38657 } }
I20260808 02:43:54.760399 688 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:54.760509 688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:54.760638 688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:54.763095 688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3feb3b2092fd482b8c4d67366dd3a940" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38657 } }
I20260808 02:43:54.763794 688 leader_election.cc:302] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3feb3b2092fd482b8c4d67366dd3a940; no voters:
I20260808 02:43:54.764554 688 leader_election.cc:288] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:54.764732 698 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:54.765543 698 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [term 1 LEADER]: Becoming Leader. State: Replica: 3feb3b2092fd482b8c4d67366dd3a940, State: Running, Role: LEADER
I20260808 02:43:54.766180 698 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3feb3b2092fd482b8c4d67366dd3a940" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38657 } }
I20260808 02:43:54.767010 688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:54.769668 700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3feb3b2092fd482b8c4d67366dd3a940. Latest consensus state: current_term: 1 leader_uuid: "3feb3b2092fd482b8c4d67366dd3a940" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3feb3b2092fd482b8c4d67366dd3a940" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38657 } } }
I20260808 02:43:54.770255 700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:54.771577 704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:54.771327 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3feb3b2092fd482b8c4d67366dd3a940" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3feb3b2092fd482b8c4d67366dd3a940" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38657 } } }
I20260808 02:43:54.771772 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:54.779040 704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:54.790045 704 catalog_manager.cc:1347] Generated new cluster ID: 5b6eb57ddd07484bb2c9f6134043f43a
I20260808 02:43:54.790205 704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:54.813226 704 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:54.813865 704 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:54.833130 704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3feb3b2092fd482b8c4d67366dd3a940: Generated new TSK 0
I20260808 02:43:54.834134 704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:54.848343 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 616
W20260808 02:43:54.849965 683 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.51:53907
W20260808 02:43:54.851172 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 616: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:54.851397 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 616
2026-08-08T02:43:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2318 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:55 dist-test-slave-8tdl krb5kdc[720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:55 dist-test-slave-8tdl krb5kdc[720](info): set up 2 sockets
Aug 08 02:43:55 dist-test-slave-8tdl krb5kdc[720](info): commencing operation
krb5kdc: starting...
W20260808 02:43:56.114768 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.006s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:56 dist-test-slave-8tdl krb5kdc[720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:43:56.518730 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:43251
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:43251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:56.908470 733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:56.908854 733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:56.908960 733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:56.916890 733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:56.917053 733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:56.917106 733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:56.917164 733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:56.917219 733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:56.928056 733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:43251
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:43251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:56.929451 733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:56.930835 733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:56.944422 742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:56.944444 739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:56.944504 738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:56.945689 733 server_base.cc:1034] running on GCE node
I20260808 02:43:56.946589 733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:56.948385 733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:56.949635 733 hybrid_clock.cc:648] HybridClock initialized: now 1786157036949583 us; error 43 us; skew 500 ppm
I20260808 02:43:56.950076 733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:56 dist-test-slave-8tdl krb5kdc[720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157036, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:56.958801 733 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:43:56.961629 733 webserver.cc:460] Webserver started at http://127.10.20.126:45797/ using document root <none> and password file <none>
I20260808 02:43:56.962558 733 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:56.962774 733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:56.963189 733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:56.967010 733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193"
format_stamp: "Formatted at 2026-08-08 02:43:56 on dist-test-slave-8tdl"
server_key: "7d4dcc9983df4bd8f93116992fdc3592"
server_key_iv: "e80c12d4239fcb91a1ac2df4d60c67f7"
server_key_version: "encryptionkey@0"
I20260808 02:43:56.967971 733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193"
format_stamp: "Formatted at 2026-08-08 02:43:56 on dist-test-slave-8tdl"
server_key: "7d4dcc9983df4bd8f93116992fdc3592"
server_key_iv: "e80c12d4239fcb91a1ac2df4d60c67f7"
server_key_version: "encryptionkey@0"
I20260808 02:43:56.974463 733 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 02:43:56.979070 749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:56.980952 733 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:56.981216 733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193"
format_stamp: "Formatted at 2026-08-08 02:43:56 on dist-test-slave-8tdl"
server_key: "7d4dcc9983df4bd8f93116992fdc3592"
server_key_iv: "e80c12d4239fcb91a1ac2df4d60c67f7"
server_key_version: "encryptionkey@0"
I20260808 02:43:56.981468 733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:56.999449 733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:57.004966 733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:57.005364 733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:57.027835 733 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:43251
I20260808 02:43:57.027873 803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:43251 every 8 connection(s)
I20260808 02:43:57.029433 733 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:57.031278 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 733
I20260808 02:43:57.031494 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:57.032008 10321 external_mini_cluster.cc:1428] Setting key 5767e6b3a9f561f2d31b3cb305f61fb8
I20260808 02:43:57.034317 804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 02:43:57 dist-test-slave-8tdl krb5kdc[720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:43:57.049701 804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193: Bootstrap starting.
I20260808 02:43:57.053826 804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:57.055150 804 log.cc:824] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:57.059615 804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193: No bootstrap required, opened a new log
I20260808 02:43:57.061115 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:57.033981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46121 (local address 127.10.20.126:43251)
0808 02:43:57.035174 (+ 1193us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:57.035191 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:57.035245 (+ 54us) server_negotiation.cc:407] Connection header received
0808 02:43:57.037660 (+ 2415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:57.037691 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:57.038308 (+ 617us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:57.038846 (+ 538us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:57.040490 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:57.042643 (+ 2153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:57.044222 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:57.045643 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:57.045878 (+ 235us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:57.051172 (+ 5294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:57.051181 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:57.051200 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:57.051249 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:57.055093 (+ 3844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:57.056498 (+ 1405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:57.056510 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:57.056526 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:57.056828 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:57.057644 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:57.057648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:57.057650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:57.058280 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:57.058553 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:57.059485 (+ 932us) server_negotiation.cc:299] Negotiation successful
0808 02:43:57.059940 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":934,"thread_start_us":580,"threads_started":1}
I20260808 02:43:57.065974 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:57.069530 804 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43251 } }
I20260808 02:43:57.070185 804 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:57.070340 804 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8a9ca26a1ac4fdaa7285e7ca57a0193, State: Initialized, Role: FOLLOWER
I20260808 02:43:57.071244 804 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43251 } }
I20260808 02:43:57.071592 804 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:57.071802 804 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:57.072023 804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:57.076009 804 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43251 } }
I20260808 02:43:57.076678 804 leader_election.cc:302] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8a9ca26a1ac4fdaa7285e7ca57a0193; no voters:
I20260808 02:43:57.077518 804 leader_election.cc:288] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:57.077695 816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:57.078449 816 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [term 1 LEADER]: Becoming Leader. State: Replica: d8a9ca26a1ac4fdaa7285e7ca57a0193, State: Running, Role: LEADER
I20260808 02:43:57.079352 816 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43251 } }
I20260808 02:43:57.081816 804 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:57.086158 818 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43251 } } }
I20260808 02:43:57.086664 818 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:57.086402 817 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8a9ca26a1ac4fdaa7285e7ca57a0193. Latest consensus state: current_term: 1 leader_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8a9ca26a1ac4fdaa7285e7ca57a0193" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 43251 } } }
I20260808 02:43:57.087528 817 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:57.090346 823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:57.095662 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:57.072226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41227 (local address 127.10.20.126:43251)
0808 02:43:57.072477 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:57.072487 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:57.073104 (+ 617us) server_negotiation.cc:407] Connection header received
0808 02:43:57.073331 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:57.073336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:57.073419 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:57.073743 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:57.075765 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:57.076669 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:57.079187 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:57.080092 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:57.080245 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:57.084150 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:57.084157 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:57.084162 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:43:57.084214 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:57.089359 (+ 5145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:57.091364 (+ 2005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:57.091371 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:57.091374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:57.091695 (+ 321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:43:57.092445 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:43:57.092450 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:43:57.092454 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:43:57.092939 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:57.093401 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:57.095167 (+ 1766us) server_negotiation.cc:299] Negotiation successful
0808 02:43:57.095341 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":79}
I20260808 02:43:57.096837 823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:57.108479 823 catalog_manager.cc:1347] Generated new cluster ID: 78787218c71842ccb7fbda84f7ddc63e
I20260808 02:43:57.108621 823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:57.125883 823 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:57.128053 823 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:57.137960 823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8a9ca26a1ac4fdaa7285e7ca57a0193: Generated new TSK 0
I20260808 02:43:57.139252 823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:57.154857 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 733
I20260808 02:43:57.157063 799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:43:57.255438 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 733
W20260808 02:43:57.277392 718 connection.cc:535] client connection to 127.10.20.126:43251 recv error: Network error: failed to read from TLS socket (remote: 127.10.20.126:43251): Connection reset by peer (error 104)
2026-08-08T02:43:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2403 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:57 dist-test-slave-8tdl krb5kdc[838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:57 dist-test-slave-8tdl krb5kdc[838](info): set up 2 sockets
Aug 08 02:43:57 dist-test-slave-8tdl krb5kdc[838](info): commencing operation
krb5kdc: starting...
W20260808 02:43:58.542733 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.004s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:43:58 dist-test-slave-8tdl krb5kdc[838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:43:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:43:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:43:58.970389 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39855
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:39855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:43:59.382925 851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:43:59.383296 851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:43:59.383459 851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:43:59.391562 851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:43:59.391716 851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:43:59.391817 851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:43:59.391906 851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:43:59.391991 851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:43:59.403716 851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:39855
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:43:59.405227 851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:43:59.406804 851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:43:59.420749 856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:59.420912 859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:43:59.421005 857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:43:59.422143 851 server_base.cc:1034] running on GCE node
I20260808 02:43:59.423254 851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:43:59.425042 851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:43:59.426344 851 hybrid_clock.cc:648] HybridClock initialized: now 1786157039426284 us; error 63 us; skew 500 ppm
I20260808 02:43:59.426870 851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:43:59 dist-test-slave-8tdl krb5kdc[838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157039, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:43:59.430904 851 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:43:59.432794 851 webserver.cc:460] Webserver started at http://127.10.20.126:44235/ using document root <none> and password file <none>
I20260808 02:43:59.433588 851 fs_manager.cc:359] Metadata directory not provided
I20260808 02:43:59.433748 851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:43:59.434074 851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:43:59.437424 851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "d2fb895e68b24249b29e0c5f7123bba5"
format_stamp: "Formatted at 2026-08-08 02:43:59 on dist-test-slave-8tdl"
server_key: "7366184e74099b04abbd3256d31bac73"
server_key_iv: "ba8b96ff2b1ba0701c02ce3e61beac53"
server_key_version: "encryptionkey@0"
I20260808 02:43:59.438311 851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "d2fb895e68b24249b29e0c5f7123bba5"
format_stamp: "Formatted at 2026-08-08 02:43:59 on dist-test-slave-8tdl"
server_key: "7366184e74099b04abbd3256d31bac73"
server_key_iv: "ba8b96ff2b1ba0701c02ce3e61beac53"
server_key_version: "encryptionkey@0"
I20260808 02:43:59.445513 851 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 02:43:59.450296 867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:43:59.452199 851 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:43:59.452471 851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "d2fb895e68b24249b29e0c5f7123bba5"
format_stamp: "Formatted at 2026-08-08 02:43:59 on dist-test-slave-8tdl"
server_key: "7366184e74099b04abbd3256d31bac73"
server_key_iv: "ba8b96ff2b1ba0701c02ce3e61beac53"
server_key_version: "encryptionkey@0"
I20260808 02:43:59.452742 851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:43:59.478112 851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:43:59.484655 851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:43:59.485035 851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:43:59.507372 851 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:39855
I20260808 02:43:59.507375 919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:39855 every 8 connection(s)
I20260808 02:43:59.508982 851 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:43:59.513371 920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:43:59.515990 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 851
I20260808 02:43:59.516193 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:43:59.516770 10321 external_mini_cluster.cc:1428] Setting key 594c32645e23b12e8197187cf9318659
I20260808 02:43:59.527405 920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5: Bootstrap starting.
I20260808 02:43:59.531082 920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5: Neither blocks nor log segments found. Creating new log.
I20260808 02:43:59.532416 920 log.cc:824] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:43:59.532837 923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:59.519243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47385 (local address 127.10.20.126:39855)
0808 02:43:59.520244 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:59.520258 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:59.520527 (+ 269us) server_negotiation.cc:407] Connection header received
0808 02:43:59.522633 (+ 2106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:59.522661 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:59.523418 (+ 757us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:59.523949 (+ 531us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:59.524648 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:59.526347 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:59.527989 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:59.528704 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:59.528924 (+ 220us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:59.530305 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:59.530313 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:59.530329 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:59.530989 (+ 660us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:59.531080 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:59.531107 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:59.531292 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:59.531591 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 02:43:59.531775 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":736,"thread_start_us":429,"threads_started":1}
I20260808 02:43:59.536031 920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5: No bootstrap required, opened a new log
I20260808 02:43:59.537402 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:43:59.545048 920 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb895e68b24249b29e0c5f7123bba5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39855 } }
I20260808 02:43:59.545562 920 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:43:59.545679 920 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2fb895e68b24249b29e0c5f7123bba5, State: Initialized, Role: FOLLOWER
I20260808 02:43:59.546298 920 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb895e68b24249b29e0c5f7123bba5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39855 } }
I20260808 02:43:59.546568 920 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:43:59.546782 920 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:43:59.546998 920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:43:59.549736 923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:43:59.542338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34631 (local address 127.10.20.126:39855)
0808 02:43:59.542555 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 02:43:59.542561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:43:59.542940 (+ 379us) server_negotiation.cc:407] Connection header received
0808 02:43:59.543102 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:43:59.543110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:43:59.543212 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:43:59.543343 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:43:59.543860 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:59.544978 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:59.546812 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:43:59.547453 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:43:59.547632 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:43:59.548897 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:43:59.548902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:43:59.548905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:43:59.548925 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:43:59.548989 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:43:59.549008 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:43:59.549141 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 02:43:59.549350 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 02:43:59.549410 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 02:43:59.550292 920 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb895e68b24249b29e0c5f7123bba5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39855 } }
I20260808 02:43:59.551066 920 leader_election.cc:302] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2fb895e68b24249b29e0c5f7123bba5; no voters:
I20260808 02:43:59.551841 920 leader_election.cc:288] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:43:59.551998 930 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:43:59.552959 930 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [term 1 LEADER]: Becoming Leader. State: Replica: d2fb895e68b24249b29e0c5f7123bba5, State: Running, Role: LEADER
I20260808 02:43:59.553622 930 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb895e68b24249b29e0c5f7123bba5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39855 } }
I20260808 02:43:59.554308 920 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:43:59.556931 932 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2fb895e68b24249b29e0c5f7123bba5. Latest consensus state: current_term: 1 leader_uuid: "d2fb895e68b24249b29e0c5f7123bba5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb895e68b24249b29e0c5f7123bba5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39855 } } }
I20260808 02:43:59.557435 932 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:59.558247 931 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2fb895e68b24249b29e0c5f7123bba5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb895e68b24249b29e0c5f7123bba5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39855 } } }
I20260808 02:43:59.558619 931 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:43:59.558733 937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:43:59.568760 937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:43:59.580801 937 catalog_manager.cc:1347] Generated new cluster ID: f339af57e8e043a4b47c4ba65e73adce
I20260808 02:43:59.581027 937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:43:59.594437 937 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:43:59.596401 937 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:43:59.604727 937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2fb895e68b24249b29e0c5f7123bba5: Generated new TSK 0
I20260808 02:43:59.605960 937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:43:59.620762 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 851
W20260808 02:43:59.622123 915 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47385
W20260808 02:43:59.622991 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 851: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:43:59.623147 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 851
W20260808 02:43:59.645972 836 connection.cc:535] client connection to 127.10.20.126:39855 recv error: Network error: failed to read from TLS socket (remote: 127.10.20.126:39855): Connection reset by peer (error 104)
2026-08-08T02:43:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2368 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:43:59 dist-test-slave-8tdl krb5kdc[953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:43:59 dist-test-slave-8tdl krb5kdc[953](info): set up 2 sockets
Aug 08 02:43:59 dist-test-slave-8tdl krb5kdc[953](info): commencing operation
krb5kdc: starting...
W20260808 02:44:00.850886 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.003s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:44:01 dist-test-slave-8tdl krb5kdc[953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:44:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:44:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:44:01.280933 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37207
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:37207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:44:01.700228 968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:01.700682 968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:01.700877 968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:01.708945 968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:01.709167 968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:01.709280 968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:01.709399 968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:01.709492 968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:01.721230 968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:37207
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:37207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:01.723302 968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:01.725482 968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:01.741863 976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:01.741863 974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:01.742067 973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:01.742654 968 server_base.cc:1034] running on GCE node
I20260808 02:44:01.743672 968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:01.745625 968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:01.746933 968 hybrid_clock.cc:648] HybridClock initialized: now 1786157041746850 us; error 76 us; skew 500 ppm
I20260808 02:44:01.747427 968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:01 dist-test-slave-8tdl krb5kdc[953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157041, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:01.751209 968 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:44:01.753120 968 webserver.cc:460] Webserver started at http://127.10.20.126:36659/ using document root <none> and password file <none>
I20260808 02:44:01.753942 968 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:01.754120 968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:01.754480 968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:01.758052 968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "afa0d7b6eaa8429b9c06bdccb26026d9"
format_stamp: "Formatted at 2026-08-08 02:44:01 on dist-test-slave-8tdl"
server_key: "68d262cf8b7305f888a066c84de03036"
server_key_iv: "3055e9d3e53f5e98239a7ad9a225c172"
server_key_version: "encryptionkey@0"
I20260808 02:44:01.759032 968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "afa0d7b6eaa8429b9c06bdccb26026d9"
format_stamp: "Formatted at 2026-08-08 02:44:01 on dist-test-slave-8tdl"
server_key: "68d262cf8b7305f888a066c84de03036"
server_key_iv: "3055e9d3e53f5e98239a7ad9a225c172"
server_key_version: "encryptionkey@0"
I20260808 02:44:01.765097 968 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:44:01.769397 983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:01.771071 968 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:44:01.771312 968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "afa0d7b6eaa8429b9c06bdccb26026d9"
format_stamp: "Formatted at 2026-08-08 02:44:01 on dist-test-slave-8tdl"
server_key: "68d262cf8b7305f888a066c84de03036"
server_key_iv: "3055e9d3e53f5e98239a7ad9a225c172"
server_key_version: "encryptionkey@0"
I20260808 02:44:01.771592 968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:01.778326 968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:01.783319 968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:01.783685 968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:01.808329 968 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:37207
I20260808 02:44:01.808353 1035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:37207 every 8 connection(s)
I20260808 02:44:01.810146 968 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:44:01.814545 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 968
I20260808 02:44:01.814971 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:44:01.815335 1036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:01.815608 10321 external_mini_cluster.cc:1428] Setting key 42f848e5a1592fd2a28a4ce267ca1a1c
I20260808 02:44:01.825733 1039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:01.817959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45747 (local address 127.10.20.126:37207)
0808 02:44:01.819110 (+ 1151us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:01.819125 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:01.819180 (+ 55us) server_negotiation.cc:407] Connection header received
0808 02:44:01.821362 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:01.821393 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:01.821850 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:01.822409 (+ 559us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:01.823743 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:01.823750 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:01.823765 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:44:01.823792 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:01.823870 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:44:01.823897 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:01.824222 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:01.824401 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 02:44:01.824620 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":853,"thread_start_us":483,"threads_started":1}
I20260808 02:44:01.830582 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:44:01.832233 1036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9: Bootstrap starting.
I20260808 02:44:01.836436 1036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:01.838196 1036 log.cc:824] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:01.839169 1039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:01.835794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49539 (local address 127.10.20.126:37207)
0808 02:44:01.836077 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:01.836088 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:01.836636 (+ 548us) server_negotiation.cc:407] Connection header received
0808 02:44:01.836861 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:01.836865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:01.836938 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:01.837063 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:01.838200 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:01.838205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:01.838208 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:44:01.838228 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:01.838277 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:44:01.838294 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:01.838473 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:01.838637 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 02:44:01.838793 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 02:44:01.841821 1036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9: No bootstrap required, opened a new log
I20260808 02:44:01.851161 1036 raft_consensus.cc:348] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37207 } }
I20260808 02:44:01.851756 1036 raft_consensus.cc:374] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:44:01.851882 1036 raft_consensus.cc:729] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa0d7b6eaa8429b9c06bdccb26026d9, State: Initialized, Role: FOLLOWER
I20260808 02:44:01.852635 1036 consensus_queue.cc:260] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37207 } }
I20260808 02:44:01.852893 1036 raft_consensus.cc:388] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:44:01.853077 1036 raft_consensus.cc:482] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:44:01.853274 1036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:01.856024 1036 raft_consensus.cc:504] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37207 } }
I20260808 02:44:01.856670 1036 leader_election.cc:302] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afa0d7b6eaa8429b9c06bdccb26026d9; no voters:
I20260808 02:44:01.857432 1036 leader_election.cc:288] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:44:01.857636 1047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:44:01.859143 1047 raft_consensus.cc:686] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [term 1 LEADER]: Becoming Leader. State: Replica: afa0d7b6eaa8429b9c06bdccb26026d9, State: Running, Role: LEADER
I20260808 02:44:01.859803 1047 consensus_queue.cc:237] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37207 } }
I20260808 02:44:01.860164 1036 sys_catalog.cc:564] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:01.863379 1048 sys_catalog.cc:455] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37207 } } }
I20260808 02:44:01.863179 1049 sys_catalog.cc:455] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afa0d7b6eaa8429b9c06bdccb26026d9. Latest consensus state: current_term: 1 leader_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afa0d7b6eaa8429b9c06bdccb26026d9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 37207 } } }
I20260808 02:44:01.863906 1048 sys_catalog.cc:458] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:01.863925 1049 sys_catalog.cc:458] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:01.867250 1055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:44:01.873994 1055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:44:01.885989 1055 catalog_manager.cc:1347] Generated new cluster ID: 1d7f0119999d400fbb29c765c1657a01
I20260808 02:44:01.886158 1055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:44:01.914821 1055 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:44:01.915597 1055 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:44:01.926527 1055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afa0d7b6eaa8429b9c06bdccb26026d9: Generated new TSK 0
I20260808 02:44:01.927842 1055 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:44:01.937526 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 968
W20260808 02:44:01.939097 1031 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45747
W20260808 02:44:01.940110 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 968: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:44:01.940300 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 968
2026-08-08T02:44:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:44:02 dist-test-slave-8tdl krb5kdc[1068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:44:02 dist-test-slave-8tdl krb5kdc[1068](info): set up 2 sockets
Aug 08 02:44:02 dist-test-slave-8tdl krb5kdc[1068](info): commencing operation
krb5kdc: starting...
W20260808 02:44:03.199424 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.002s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:44:03 dist-test-slave-8tdl krb5kdc[1068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:44:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:44:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:44:03.607834 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:33203
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:46341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:33203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:44:04.006179 1082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:04.006608 1082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:04.006840 1082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:04.016860 1082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:04.017014 1082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:04.017102 1082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:04.017215 1082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:04.017280 1082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:04.028528 1082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:46341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:33203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:33203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:04.030066 1082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:04.031548 1082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:04.045209 1088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:04.045274 1089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:04.045307 1091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:04.046185 1082 server_base.cc:1034] running on GCE node
I20260808 02:44:04.047178 1082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:04.048810 1082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:04.050132 1082 hybrid_clock.cc:648] HybridClock initialized: now 1786157044050072 us; error 49 us; skew 500 ppm
I20260808 02:44:04.050527 1082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:04 dist-test-slave-8tdl krb5kdc[1068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157044, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:04.054332 1082 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:44:04.056480 1082 webserver.cc:460] Webserver started at http://127.10.20.126:33639/ using document root <none> and password file <none>
I20260808 02:44:04.057301 1082 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:04.057448 1082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:04.057807 1082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:04.061299 1082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "baa00557a7d2458395c4ad3644c24346"
format_stamp: "Formatted at 2026-08-08 02:44:04 on dist-test-slave-8tdl"
server_key: "e314ae15e45b8d91e475746a13e61037"
server_key_iv: "89d9ee82b49c9daeceb77f5cba20028c"
server_key_version: "encryptionkey@0"
I20260808 02:44:04.062223 1082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "baa00557a7d2458395c4ad3644c24346"
format_stamp: "Formatted at 2026-08-08 02:44:04 on dist-test-slave-8tdl"
server_key: "e314ae15e45b8d91e475746a13e61037"
server_key_iv: "89d9ee82b49c9daeceb77f5cba20028c"
server_key_version: "encryptionkey@0"
I20260808 02:44:04.068358 1082 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 02:44:04.072597 1098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:04.074154 1082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:44:04.074368 1082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "baa00557a7d2458395c4ad3644c24346"
format_stamp: "Formatted at 2026-08-08 02:44:04 on dist-test-slave-8tdl"
server_key: "e314ae15e45b8d91e475746a13e61037"
server_key_iv: "89d9ee82b49c9daeceb77f5cba20028c"
server_key_version: "encryptionkey@0"
I20260808 02:44:04.074616 1082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:04.092569 1082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:04.098562 1082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:04.098953 1082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:04.122042 1082 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:33203
I20260808 02:44:04.122145 1151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:33203 every 8 connection(s)
I20260808 02:44:04.123668 1082 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:44:04.127969 1152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:04.128892 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1082
I20260808 02:44:04.129096 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:44:04.129694 10321 external_mini_cluster.cc:1428] Setting key c93e843fce71a7bbce5f5e4039cc3a1d
I20260808 02:44:04.145184 1152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346: Bootstrap starting.
Aug 08 02:44:04 dist-test-slave-8tdl krb5kdc[1068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:44:04.149629 1152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:04.151067 1152 log.cc:824] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:04.154896 1152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346: No bootstrap required, opened a new log
I20260808 02:44:04.158594 1156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:04.131872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38559 (local address 127.10.20.126:33203)
0808 02:44:04.133013 (+ 1141us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:04.133027 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:04.133076 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:44:04.135543 (+ 2467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:04.135576 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:04.136129 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:04.136537 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:04.138626 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:04.140481 (+ 1855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:04.143001 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:04.143826 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:04.144013 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:04.149788 (+ 5775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:04.149803 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:04.149827 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:04.149904 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:04.153692 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:04.154629 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:04.154637 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:04.154644 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:04.154921 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:04.155374 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:04.155383 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:04.155385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:04.156008 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:04.156356 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:04.156917 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 02:44:04.157423 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":870,"thread_start_us":609,"threads_started":1}
I20260808 02:44:04.163605 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:44:04.164606 1152 raft_consensus.cc:348] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baa00557a7d2458395c4ad3644c24346" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33203 } }
I20260808 02:44:04.165063 1152 raft_consensus.cc:374] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:44:04.165179 1152 raft_consensus.cc:729] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa00557a7d2458395c4ad3644c24346, State: Initialized, Role: FOLLOWER
I20260808 02:44:04.165864 1152 consensus_queue.cc:260] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baa00557a7d2458395c4ad3644c24346" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33203 } }
I20260808 02:44:04.166152 1152 raft_consensus.cc:388] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:44:04.166313 1152 raft_consensus.cc:482] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:44:04.166495 1152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:04.169029 1152 raft_consensus.cc:504] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baa00557a7d2458395c4ad3644c24346" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33203 } }
I20260808 02:44:04.169737 1152 leader_election.cc:302] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baa00557a7d2458395c4ad3644c24346; no voters:
I20260808 02:44:04.170553 1152 leader_election.cc:288] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:44:04.170749 1163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:44:04.172792 1163 raft_consensus.cc:686] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [term 1 LEADER]: Becoming Leader. State: Replica: baa00557a7d2458395c4ad3644c24346, State: Running, Role: LEADER
I20260808 02:44:04.173301 1152 sys_catalog.cc:564] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:04.173610 1163 consensus_queue.cc:237] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baa00557a7d2458395c4ad3644c24346" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33203 } }
I20260808 02:44:04.180501 1165 sys_catalog.cc:455] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baa00557a7d2458395c4ad3644c24346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baa00557a7d2458395c4ad3644c24346" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33203 } } }
I20260808 02:44:04.181109 1165 sys_catalog.cc:458] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:04.191300 1173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:44:04.193616 1166 sys_catalog.cc:455] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [sys.catalog]: SysCatalogTable state changed. Reason: New leader baa00557a7d2458395c4ad3644c24346. Latest consensus state: current_term: 1 leader_uuid: "baa00557a7d2458395c4ad3644c24346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baa00557a7d2458395c4ad3644c24346" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 33203 } } }
I20260808 02:44:04.194828 1156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:04.169155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51673 (local address 127.10.20.126:33203)
0808 02:44:04.169440 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:04.169451 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:04.169995 (+ 544us) server_negotiation.cc:407] Connection header received
0808 02:44:04.170171 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:04.170176 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:04.170284 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:04.170432 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:04.172563 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:04.173933 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:04.176357 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:04.177348 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:04.177533 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:04.182580 (+ 5047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:04.182591 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:04.182599 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:04.182707 (+ 108us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:04.188321 (+ 5614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:04.189968 (+ 1647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:04.189979 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:04.189994 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:04.190249 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:04.191014 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:04.191026 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:04.191033 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:04.191769 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:04.192218 (+ 449us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:04.193869 (+ 1651us) server_negotiation.cc:299] Negotiation successful
0808 02:44:04.194243 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:44:04.194772 1166 sys_catalog.cc:458] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:04.200138 1173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:44:04.214177 1173 catalog_manager.cc:1347] Generated new cluster ID: b666ed0c4e0d4c559c548d0b0ed54cf7
I20260808 02:44:04.214349 1173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:44:04.223932 1173 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:44:04.225466 1173 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:44:04.238504 1173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P baa00557a7d2458395c4ad3644c24346: Generated new TSK 0
I20260808 02:44:04.239401 1173 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:44:04.254503 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1082
I20260808 02:44:04.255978 1147 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:04.355799 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1082
2026-08-08T02:44:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:44:04 dist-test-slave-8tdl krb5kdc[1188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:44:04 dist-test-slave-8tdl krb5kdc[1188](info): set up 2 sockets
Aug 08 02:44:04 dist-test-slave-8tdl krb5kdc[1188](info): commencing operation
krb5kdc: starting...
W20260808 02:44:05.602873 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:44:05 dist-test-slave-8tdl krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:44:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:44:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:44:06.018869 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35397
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:35397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:44:06.401314 1201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:06.401711 1201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:06.401886 1201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:06.409860 1201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:06.410063 1201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:06.410179 1201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:06.410290 1201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:06.410364 1201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:06.421319 1201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:35397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:35397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:06.422822 1201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:06.424270 1201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:06.437562 1207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:06.437775 1206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:06.438171 1209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:06.438779 1201 server_base.cc:1034] running on GCE node
I20260808 02:44:06.439837 1201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:06.441706 1201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:06.443010 1201 hybrid_clock.cc:648] HybridClock initialized: now 1786157046442947 us; error 78 us; skew 500 ppm
I20260808 02:44:06.443445 1201 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:06 dist-test-slave-8tdl krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157046, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:06.447363 1201 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:44:06.449343 1201 webserver.cc:460] Webserver started at http://127.10.20.126:35963/ using document root <none> and password file <none>
I20260808 02:44:06.450191 1201 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:06.450363 1201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:06.450790 1201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:06.454447 1201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "cf01e2eef74f414e8a34157cb73192e5"
format_stamp: "Formatted at 2026-08-08 02:44:06 on dist-test-slave-8tdl"
server_key: "17ed79fd78cd515bfce9fe30d9f5c72b"
server_key_iv: "06dc797982833963e90f5340683c1c50"
server_key_version: "encryptionkey@0"
I20260808 02:44:06.455482 1201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "cf01e2eef74f414e8a34157cb73192e5"
format_stamp: "Formatted at 2026-08-08 02:44:06 on dist-test-slave-8tdl"
server_key: "17ed79fd78cd515bfce9fe30d9f5c72b"
server_key_iv: "06dc797982833963e90f5340683c1c50"
server_key_version: "encryptionkey@0"
I20260808 02:44:06.461882 1201 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:44:06.466435 1216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:06.468286 1201 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:44:06.468539 1201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "cf01e2eef74f414e8a34157cb73192e5"
format_stamp: "Formatted at 2026-08-08 02:44:06 on dist-test-slave-8tdl"
server_key: "17ed79fd78cd515bfce9fe30d9f5c72b"
server_key_iv: "06dc797982833963e90f5340683c1c50"
server_key_version: "encryptionkey@0"
I20260808 02:44:06.468792 1201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:06.492898 1201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:06.498253 1201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:06.498710 1201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:06.521173 1201 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:35397
I20260808 02:44:06.521201 1271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:35397 every 8 connection(s)
I20260808 02:44:06.522779 1201 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:44:06.527247 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:06.529736 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1201
I20260808 02:44:06.529958 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:44:06.530608 10321 external_mini_cluster.cc:1428] Setting key 3dc753d752e77b71d6c3d41af3dfed01
I20260808 02:44:06.541854 1272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5: Bootstrap starting.
I20260808 02:44:06.546046 1272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:06.546763 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:06.532821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45839 (local address 127.10.20.126:35397)
0808 02:44:06.533828 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:06.533842 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:06.533902 (+ 60us) server_negotiation.cc:407] Connection header received
0808 02:44:06.535840 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:06.535873 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:06.536344 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:06.536711 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:06.537463 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:06.539089 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:06.541092 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:06.542052 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:06.542239 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:06.543761 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:06.543781 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:06.543798 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:44:06.544511 (+ 713us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:06.544620 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:44:06.544659 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:06.544774 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:06.545108 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 02:44:06.545469 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":510,"threads_started":1}
I20260808 02:44:06.547634 1272 log.cc:824] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:06.551612 1272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5: No bootstrap required, opened a new log
I20260808 02:44:06.551823 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:44:06.561477 1272 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf01e2eef74f414e8a34157cb73192e5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35397 } }
I20260808 02:44:06.562129 1272 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:44:06.562278 1272 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf01e2eef74f414e8a34157cb73192e5, State: Initialized, Role: FOLLOWER
I20260808 02:44:06.563014 1272 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf01e2eef74f414e8a34157cb73192e5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35397 } }
I20260808 02:44:06.563299 1272 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:44:06.563457 1272 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:44:06.563658 1272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:06.564831 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:06.557190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39445 (local address 127.10.20.126:35397)
0808 02:44:06.557454 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:06.557462 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:06.557797 (+ 335us) server_negotiation.cc:407] Connection header received
0808 02:44:06.558061 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:06.558066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:06.558159 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:06.558266 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:06.559014 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:06.559791 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:06.561813 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:06.562583 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:06.562782 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:06.564031 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:06.564036 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:06.564039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:44:06.564060 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:06.564105 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:44:06.564122 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:06.564197 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:06.564387 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 02:44:06.564482 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260808 02:44:06.566951 1272 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf01e2eef74f414e8a34157cb73192e5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35397 } }
I20260808 02:44:06.567533 1272 leader_election.cc:302] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf01e2eef74f414e8a34157cb73192e5; no voters:
I20260808 02:44:06.568233 1272 leader_election.cc:288] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:44:06.568413 1282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:44:06.569234 1282 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [term 1 LEADER]: Becoming Leader. State: Replica: cf01e2eef74f414e8a34157cb73192e5, State: Running, Role: LEADER
I20260808 02:44:06.569876 1282 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf01e2eef74f414e8a34157cb73192e5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35397 } }
I20260808 02:44:06.572008 1283 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf01e2eef74f414e8a34157cb73192e5. Latest consensus state: current_term: 1 leader_uuid: "cf01e2eef74f414e8a34157cb73192e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf01e2eef74f414e8a34157cb73192e5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35397 } } }
I20260808 02:44:06.572470 1283 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:06.573012 1272 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:06.574968 1284 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf01e2eef74f414e8a34157cb73192e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf01e2eef74f414e8a34157cb73192e5" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 35397 } } }
I20260808 02:44:06.575515 1284 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:06.583381 1286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:44:06.589736 1286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:44:06.599923 1286 catalog_manager.cc:1347] Generated new cluster ID: 18f14cce01de43cfaea40abd6d7054be
I20260808 02:44:06.600067 1286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:44:06.627642 1286 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:44:06.629130 1286 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:44:06.648923 1286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf01e2eef74f414e8a34157cb73192e5: Generated new TSK 0
I20260808 02:44:06.650169 1286 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:44:06.662112 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1201
W20260808 02:44:06.663455 1267 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45839
W20260808 02:44:06.664402 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1201: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:44:06.664642 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1201
2026-08-08T02:44:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2309 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:44:06 dist-test-slave-8tdl krb5kdc[1304](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:44:06 dist-test-slave-8tdl krb5kdc[1304](info): set up 2 sockets
Aug 08 02:44:06 dist-test-slave-8tdl krb5kdc[1304](info): commencing operation
krb5kdc: starting...
W20260808 02:44:07.885716 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.064s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:44:08 dist-test-slave-8tdl krb5kdc[1304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:44:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:44:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:44:08.299141 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39679
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:32989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:39679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:44:08.682490 1318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:08.683022 1318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:08.683158 1318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:08.691133 1318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:08.691282 1318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:08.691332 1318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:08.691397 1318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:08.691447 1318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:08.702275 1318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:32989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:39679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:39679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:08.703763 1318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:08.705196 1318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:08.718781 1323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:08.718696 1326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:08.718650 1324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:08.719933 1318 server_base.cc:1034] running on GCE node
I20260808 02:44:08.721019 1318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:08.722807 1318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:08.724105 1318 hybrid_clock.cc:648] HybridClock initialized: now 1786157048724034 us; error 70 us; skew 500 ppm
I20260808 02:44:08.724574 1318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:08 dist-test-slave-8tdl krb5kdc[1304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:08.734599 1318 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:44:08.736618 1318 webserver.cc:460] Webserver started at http://127.10.20.126:45997/ using document root <none> and password file <none>
I20260808 02:44:08.737464 1318 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:08.737596 1318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:08.737882 1318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:08.741593 1318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "66f0073898cb461daeec63a256826c7f"
format_stamp: "Formatted at 2026-08-08 02:44:08 on dist-test-slave-8tdl"
server_key: "981a74fa098cdec7730f3b4f92631d78"
server_key_iv: "3de9bce23d2bbcc92133a003c4953be0"
server_key_version: "encryptionkey@0"
I20260808 02:44:08.742527 1318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "66f0073898cb461daeec63a256826c7f"
format_stamp: "Formatted at 2026-08-08 02:44:08 on dist-test-slave-8tdl"
server_key: "981a74fa098cdec7730f3b4f92631d78"
server_key_iv: "3de9bce23d2bbcc92133a003c4953be0"
server_key_version: "encryptionkey@0"
I20260808 02:44:08.749336 1318 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:44:08.754264 1333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:08.756167 1318 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 02:44:08.756371 1318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "66f0073898cb461daeec63a256826c7f"
format_stamp: "Formatted at 2026-08-08 02:44:08 on dist-test-slave-8tdl"
server_key: "981a74fa098cdec7730f3b4f92631d78"
server_key_iv: "3de9bce23d2bbcc92133a003c4953be0"
server_key_version: "encryptionkey@0"
I20260808 02:44:08.756600 1318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:08.763079 1318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:08.768154 1318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:08.768461 1318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:08.790856 1318 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:39679
I20260808 02:44:08.790879 1390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:39679 every 8 connection(s)
I20260808 02:44:08.792577 1318 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:44:08.797397 1391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:08.801287 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1318
I20260808 02:44:08.801573 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:44:08.802156 10321 external_mini_cluster.cc:1428] Setting key b2305ed023a6f4ed59251165b8493752
I20260808 02:44:08.812446 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:08.804633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59259 (local address 127.10.20.126:39679)
0808 02:44:08.805615 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:08.805629 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:08.805678 (+ 49us) server_negotiation.cc:407] Connection header received
0808 02:44:08.808026 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:08.808076 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:08.808621 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:08.809063 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:08.810412 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:08.810420 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:08.810439 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:44:08.810461 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:08.810540 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:44:08.810564 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:08.810916 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:08.811076 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 02:44:08.811309 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":447,"threads_started":1}
I20260808 02:44:08.813318 1391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f: Bootstrap starting.
I20260808 02:44:08.816890 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:44:08.817354 1391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:08.819033 1391 log.cc:824] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:08.824108 1391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f: No bootstrap required, opened a new log
I20260808 02:44:08.827232 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:08.823943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33593 (local address 127.10.20.126:39679)
0808 02:44:08.824177 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:08.824186 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:08.824674 (+ 488us) server_negotiation.cc:407] Connection header received
0808 02:44:08.824843 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:08.824848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:08.824922 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:08.825064 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:08.826303 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:08.826312 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:08.826321 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 02:44:08.826347 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:08.826421 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 02:44:08.826446 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:08.826614 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:08.826796 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 02:44:08.826876 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 02:44:08.834745 1391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f0073898cb461daeec63a256826c7f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39679 } }
I20260808 02:44:08.835251 1391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 02:44:08.835386 1391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66f0073898cb461daeec63a256826c7f, State: Initialized, Role: FOLLOWER
I20260808 02:44:08.836077 1391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f0073898cb461daeec63a256826c7f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39679 } }
I20260808 02:44:08.836350 1391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 02:44:08.836527 1391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 02:44:08.836721 1391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:08.839823 1391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f0073898cb461daeec63a256826c7f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39679 } }
I20260808 02:44:08.840626 1391 leader_election.cc:302] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66f0073898cb461daeec63a256826c7f; no voters:
I20260808 02:44:08.841457 1391 leader_election.cc:288] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 02:44:08.841589 1401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:44:08.842521 1401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [term 1 LEADER]: Becoming Leader. State: Replica: 66f0073898cb461daeec63a256826c7f, State: Running, Role: LEADER
I20260808 02:44:08.843482 1401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f0073898cb461daeec63a256826c7f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39679 } }
I20260808 02:44:08.844280 1391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:08.848649 1403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66f0073898cb461daeec63a256826c7f. Latest consensus state: current_term: 1 leader_uuid: "66f0073898cb461daeec63a256826c7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f0073898cb461daeec63a256826c7f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39679 } } }
I20260808 02:44:08.849756 1403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:08.849397 1402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66f0073898cb461daeec63a256826c7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f0073898cb461daeec63a256826c7f" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 39679 } } }
I20260808 02:44:08.850435 1402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:08.851684 1410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:44:08.858384 1410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:44:08.871726 1410 catalog_manager.cc:1347] Generated new cluster ID: 4edb368f045f483eb6e21099234cf9dc
I20260808 02:44:08.871886 1410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:44:08.890031 1410 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:44:08.890812 1410 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:44:08.899497 1410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66f0073898cb461daeec63a256826c7f: Generated new TSK 0
I20260808 02:44:08.900488 1410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 02:44:08.911487 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1318
W20260808 02:44:08.912863 1385 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59259
W20260808 02:44:08.913697 10321 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1318: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 02:44:08.913858 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1318
2026-08-08T02:44:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2249 ms)
[----------] 18 tests from AuthTokenIssuingTest (42529 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:44:09 dist-test-slave-8tdl krb5kdc[1422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:44:09 dist-test-slave-8tdl krb5kdc[1422](info): set up 2 sockets
Aug 08 02:44:09 dist-test-slave-8tdl krb5kdc[1422](info): commencing operation
krb5kdc: starting...
W20260808 02:44:10.199281 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.004s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:44:10 dist-test-slave-8tdl krb5kdc[1422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:44:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:44:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:44:10.615577 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:36595
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:36595,127.10.20.125:33915,127.10.20.124:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:44:11.008828 1436 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:44:11.009277 1436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:11.009392 1436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:11.009549 1436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:11.017664 1436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:11.017823 1436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:11.017930 1436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:11.018082 1436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:11.018167 1436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:11.030586 1436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:36595,127.10.20.125:33915,127.10.20.124:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:36595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:11.032045 1436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:11.033891 1436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:11.049919 1443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:11.050333 1442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:11.050527 1445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:11.051736 1436 server_base.cc:1034] running on GCE node
I20260808 02:44:11.052779 1436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:11.054489 1436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:11.055791 1436 hybrid_clock.cc:648] HybridClock initialized: now 1786157051055704 us; error 92 us; skew 500 ppm
I20260808 02:44:11.056253 1436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:11 dist-test-slave-8tdl krb5kdc[1422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:11.060985 1436 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:44:11.063251 1436 webserver.cc:460] Webserver started at http://127.10.20.126:43985/ using document root <none> and password file <none>
I20260808 02:44:11.064145 1436 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:11.064311 1436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:11.064702 1436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:11.069310 1436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "3dc78e8b354d4696b717808c6c3920e9"
format_stamp: "Formatted at 2026-08-08 02:44:11 on dist-test-slave-8tdl"
server_key: "d4ac7c00ee6e1c28fb8ffe4f1a55f354"
server_key_iv: "2ff36e1bf97b38e1de074358b12fac3b"
server_key_version: "encryptionkey@0"
I20260808 02:44:11.070614 1436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "3dc78e8b354d4696b717808c6c3920e9"
format_stamp: "Formatted at 2026-08-08 02:44:11 on dist-test-slave-8tdl"
server_key: "d4ac7c00ee6e1c28fb8ffe4f1a55f354"
server_key_iv: "2ff36e1bf97b38e1de074358b12fac3b"
server_key_version: "encryptionkey@0"
I20260808 02:44:11.077935 1436 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:44:11.083395 1453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:11.085299 1436 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260808 02:44:11.085570 1436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "3dc78e8b354d4696b717808c6c3920e9"
format_stamp: "Formatted at 2026-08-08 02:44:11 on dist-test-slave-8tdl"
server_key: "d4ac7c00ee6e1c28fb8ffe4f1a55f354"
server_key_iv: "2ff36e1bf97b38e1de074358b12fac3b"
server_key_version: "encryptionkey@0"
I20260808 02:44:11.085902 1436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:11.112417 1436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:11.118041 1436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:11.118458 1436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:11.143688 1436 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:36595
I20260808 02:44:11.143729 1505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:36595 every 8 connection(s)
I20260808 02:44:11.145282 1436 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:44:11.148993 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1436
I20260808 02:44:11.149335 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:44:11.150249 1506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:11.150463 10321 external_mini_cluster.cc:1428] Setting key fe86562ac4443602d1a5d465307fd97e
I20260808 02:44:11.163173 1506 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:11 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.20.125@KRBTEST.COM; defaulting to no policy
I20260808 02:44:11.196108 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.168156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:36595 (local address 127.0.0.1:36816)
0808 02:44:11.169265 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.169334 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:11.172441 (+ 3107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:11.173729 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:11.173746 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:11.174839 (+ 1093us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:11.175489 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.175535 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.177295 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.177305 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.179716 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.179751 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.181080 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.181092 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.181361 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.182328 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:11.182405 (+ 77us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:11.185879 (+ 3474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:11.190894 (+ 5015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.190911 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.190926 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.191640 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.192277 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.192283 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.192287 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.192477 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.193363 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:11.193371 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:11.193619 (+ 248us) client_negotiation.cc:769] Sending connection context
0808 02:44:11.193869 (+ 250us) client_negotiation.cc:240] Negotiation successful
0808 02:44:11.194524 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":169,"thread_start_us":489,"threads_started":1}
I20260808 02:44:11.196130 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.168156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36816 (local address 127.10.20.126:36595)
0808 02:44:11.170317 (+ 2161us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:11.170333 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:11.170390 (+ 57us) server_negotiation.cc:407] Connection header received
0808 02:44:11.173073 (+ 2683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:11.173082 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:11.173396 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:11.173644 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:11.175796 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.177096 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.179962 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.180733 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.180911 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.186203 (+ 5292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:11.186213 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:11.186227 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:11.186268 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:11.190655 (+ 4387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.191797 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.191811 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.191813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.192006 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.192616 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.192625 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.192628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.193219 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:11.193462 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:11.194016 (+ 554us) server_negotiation.cc:299] Negotiation successful
0808 02:44:11.194392 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1916,"spinlock_wait_cycles":20352,"thread_start_us":1672,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.125@KRBTEST.COM" created.
I20260808 02:44:11.199914 1506 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:44:11.201498 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.200869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:46936)
0808 02:44:11.201118 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.201289 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 02:44:11.201859 1457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
I20260808 02:44:11.203908 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.203339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:46950)
0808 02:44:11.203577 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.203685 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 02:44:11.204217 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:33915: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab.
Entry for principal kudu/127.10.20.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab.
I20260808 02:44:11.248916 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:33915
--webserver_interface=127.10.20.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab
--principal=kudu/127.10.20.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:36595,127.10.20.125:33915,127.10.20.124:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:44:11.253741 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } attempt: 1
I20260808 02:44:11.255548 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.254946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:46966)
0808 02:44:11.255202 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.255363 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 02:44:11.257587 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.256878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:46982)
0808 02:44:11.257136 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.257337 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260808 02:44:11.258018 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:33915: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
I20260808 02:44:11.326437 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } attempt: 2
I20260808 02:44:11.327960 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.327370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:46988)
0808 02:44:11.327649 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.327772 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 02:44:11.329159 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.328722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:46990)
0808 02:44:11.328909 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.329004 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:44:11.329458 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:33915: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
I20260808 02:44:11.420833 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } attempt: 3
I20260808 02:44:11.422228 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.421697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47004)
0808 02:44:11.421949 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.422074 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 02:44:11.423599 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.423149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47020)
0808 02:44:11.423318 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.423412 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:44:11.423812 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:33915: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
I20260808 02:44:11.567081 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } attempt: 4
I20260808 02:44:11.568620 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.567904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47026)
0808 02:44:11.568304 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.568420 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198}
I20260808 02:44:11.570096 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.569487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47042)
0808 02:44:11.569671 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.569830 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 02:44:11.570335 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:33915: Network error: Client connection negotiation failed: client connection to 127.10.20.125:33915: connect: Connection refused (error 111)
W20260808 02:44:11.651934 1514 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:44:11.652309 1514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:11.652400 1514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:11.652487 1514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:11.660694 1514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:11.660825 1514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:11.660889 1514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:11.660938 1514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:11.661005 1514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:11.671658 1514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:36595,127.10.20.125:33915,127.10.20.124:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab
--principal=kudu/127.10.20.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:33915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.20.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:11.673139 1514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:11.674521 1514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:11.688241 1523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:11.688279 1519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:11.688279 1521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:11.689386 1514 server_base.cc:1034] running on GCE node
I20260808 02:44:11.690387 1514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:11.692284 1514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:11.693547 1514 hybrid_clock.cc:648] HybridClock initialized: now 1786157051693465 us; error 40 us; skew 500 ppm
I20260808 02:44:11.693969 1514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:11 dist-test-slave-8tdl krb5kdc[1422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:11.698192 1514 init.cc:377] Logged in from keytab as kudu/127.10.20.125@KRBTEST.COM (short username kudu)
I20260808 02:44:11.700129 1514 webserver.cc:460] Webserver started at http://127.10.20.125:36019/ using document root <none> and password file <none>
I20260808 02:44:11.700969 1514 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:11.701120 1514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:11.701484 1514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:11.705197 1514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data/instance:
uuid: "c9d04de5ea8643ed91abce8dfbb61784"
format_stamp: "Formatted at 2026-08-08 02:44:11 on dist-test-slave-8tdl"
server_key: "746c772d2652ae846b6a7410e9d06e88"
server_key_iv: "26939fcd1e7cf40bbc247f8b0bdacaf2"
server_key_version: "encryptionkey@0"
I20260808 02:44:11.706207 1514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal/instance:
uuid: "c9d04de5ea8643ed91abce8dfbb61784"
format_stamp: "Formatted at 2026-08-08 02:44:11 on dist-test-slave-8tdl"
server_key: "746c772d2652ae846b6a7410e9d06e88"
server_key_iv: "26939fcd1e7cf40bbc247f8b0bdacaf2"
server_key_version: "encryptionkey@0"
I20260808 02:44:11.712651 1514 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 02:44:11.717119 1531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:11.718907 1514 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 02:44:11.719167 1514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal
uuid: "c9d04de5ea8643ed91abce8dfbb61784"
format_stamp: "Formatted at 2026-08-08 02:44:11 on dist-test-slave-8tdl"
server_key: "746c772d2652ae846b6a7410e9d06e88"
server_key_iv: "26939fcd1e7cf40bbc247f8b0bdacaf2"
server_key_version: "encryptionkey@0"
I20260808 02:44:11.719444 1514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:11.751658 1514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:11.756793 1514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:11.757133 1514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:11.779853 1514 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.125:33915
I20260808 02:44:11.779879 1587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.125:33915 every 8 connection(s)
I20260808 02:44:11.781483 1514 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
I20260808 02:44:11.783124 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1514
I20260808 02:44:11.783370 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-1/wal/instance
I20260808 02:44:11.783986 10321 external_mini_cluster.cc:1428] Setting key 5e465d070c7884ae41405e3ac3fa44a2
I20260808 02:44:11.787722 1588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:11.800486 1588 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:11 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.20.124@KRBTEST.COM; defaulting to no policy
I20260808 02:44:11.826184 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.804629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.10.20.126:36595)
0808 02:44:11.805181 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:11.805187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:11.806591 (+ 1404us) server_negotiation.cc:407] Connection header received
0808 02:44:11.808822 (+ 2231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:11.808829 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:11.808944 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:11.809074 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:11.811033 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.811773 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.813520 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.813971 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.814123 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.818813 (+ 4690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:11.818820 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:11.818823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:11.818877 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:11.822226 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.823307 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.823312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.823315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.823456 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.823949 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.823953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.823956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.824275 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:11.824476 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:11.825421 (+ 945us) server_negotiation.cc:299] Negotiation successful
0808 02:44:11.825637 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":333,"threads_started":1}
I20260808 02:44:11.827291 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.805486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:36595 (local address 127.0.0.1:36832)
0808 02:44:11.806398 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.806441 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:11.808473 (+ 2032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:11.809394 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:11.809405 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:11.810022 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:11.810761 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.810786 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.811986 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.811990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.813322 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.813338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.814250 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.814258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.814538 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.815625 (+ 1087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:11.815654 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:11.818475 (+ 2821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:11.822453 (+ 3978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.822470 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.822493 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.823142 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.823593 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.823603 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.823605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.823810 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.824421 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:11.824429 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:11.824869 (+ 440us) client_negotiation.cc:769] Sending connection context
0808 02:44:11.825236 (+ 367us) client_negotiation.cc:240] Negotiation successful
0808 02:44:11.825752 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":419,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.124@KRBTEST.COM" created.
I20260808 02:44:11.829550 1588 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:11 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:11.856139 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.832882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47048)
0808 02:44:11.833148 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.833174 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:11.833330 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:11.836924 (+ 3594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:11.836929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:11.837615 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:11.837895 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.837912 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.840209 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.840219 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.841832 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.841859 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.843802 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.843811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.844068 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.845015 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:11.845053 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:11.849162 (+ 4109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:11.853310 (+ 4148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.853325 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.853329 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.853732 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.854153 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.854158 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.854162 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.854310 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.855080 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:11.855085 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:11.855235 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 02:44:11.855386 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 02:44:11.855717 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 02:44:11.856262 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.833460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47048 (local address 127.10.20.125:33915)
0808 02:44:11.835767 (+ 2307us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:11.835805 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:11.835851 (+ 46us) server_negotiation.cc:407] Connection header received
0808 02:44:11.835947 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:11.835957 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:11.836301 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:11.836553 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:11.838166 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.839974 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.842068 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.843316 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.843494 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.849450 (+ 5956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:11.849469 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:11.849487 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:11.849524 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:11.853102 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.853897 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.853904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.853906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.854027 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.854428 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.854436 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.854439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.854938 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:11.855169 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:11.855558 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 02:44:11.855859 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":1810,"spinlock_wait_cycles":191232,"thread_start_us":1966,"threads_started":1}
I20260808 02:44:11.859015 1588 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:44:11.860394 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.859848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58204)
0808 02:44:11.860064 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.860211 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 02:44:11.860785 1532 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:11.863004 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.862538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58212)
0808 02:44:11.862735 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.862839 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 02:44:11.863626 1588 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:11.870184 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } attempt: 5
Aug 08 02:44:11 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:11.885835 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.871028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47062)
0808 02:44:11.871276 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.871304 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:11.871470 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:11.871834 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:11.871839 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:11.872281 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:11.872479 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.872490 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.873528 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.873534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.874564 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:11.874578 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.875438 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.875444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:11.875674 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.876314 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:11.876333 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:11.878605 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:11.882548 (+ 3943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.882555 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.882560 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.883231 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.883655 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:11.883661 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:11.883665 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:11.883850 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:11.884817 (+ 967us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:11.884824 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:11.885012 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 02:44:11.885190 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 02:44:11.885465 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 02:44:11.886073 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.871351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.10.20.125:33915)
0808 02:44:11.871545 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:11.871550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:11.871569 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:44:11.871624 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:11.871628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:11.871686 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:11.871800 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:11.872675 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.873376 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.874749 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:11.875242 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:11.875384 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:11.878864 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:11.878869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:11.878873 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:11.878910 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:11.882371 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.883378 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.883385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.883394 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.883534 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:11.884013 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:11.884022 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:11.884028 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:11.884541 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:11.884756 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:11.885350 (+ 594us) server_negotiation.cc:299] Negotiation successful
0808 02:44:11.885621 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 02:44:11.887403 1506 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:44:11.889065 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.888434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58224)
0808 02:44:11.888697 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.888821 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 02:44:11.890446 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.889941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58234)
0808 02:44:11.890151 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.890269 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 02:44:11.890717 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab.
Entry for principal kudu/127.10.20.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab.
W20260808 02:44:11.891353 10321 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.20.124: real 0.107s user 0.002s sys 0.037s
I20260808 02:44:11.892179 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:39455
--webserver_interface=127.10.20.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab
--principal=kudu/127.10.20.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:45151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:36595,127.10.20.125:33915,127.10.20.124:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:44:11.913031 1588 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 1
I20260808 02:44:11.914582 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.913911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58240)
0808 02:44:11.914190 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.914340 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 02:44:11.916136 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.915555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58242)
0808 02:44:11.915796 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.915938 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 02:44:11.916466 1588 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:11.942008 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 1
I20260808 02:44:11.943779 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.942990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58246)
0808 02:44:11.943298 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.943477 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 02:44:11.945227 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.944728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58250)
0808 02:44:11.944954 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.945061 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 02:44:11.945521 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:11.984743 1588 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 2
I20260808 02:44:11.986370 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.985685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58256)
0808 02:44:11.986009 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.986145 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 02:44:11.988031 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:11.987377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58264)
0808 02:44:11.987620 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:11.987764 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 02:44:11.988469 1588 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:12.013809 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 2
I20260808 02:44:12.015522 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.014667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58278)
0808 02:44:12.015111 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.015254 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260808 02:44:12.017547 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.016995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58286)
0808 02:44:12.017228 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.017346 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 02:44:12.017894 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:12.079746 1588 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 3
I20260808 02:44:12.081375 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.080648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58292)
0808 02:44:12.080947 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.081100 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 02:44:12.083079 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.082341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58300)
0808 02:44:12.082711 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.082844 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
W20260808 02:44:12.083452 1588 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:12.124178 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 3
I20260808 02:44:12.125675 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.125037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58314)
0808 02:44:12.125287 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.125421 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 02:44:12.127471 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.126489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58324)
0808 02:44:12.127051 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.127191 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"threads_started":1}
W20260808 02:44:12.128388 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:12.226786 1588 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 4
I20260808 02:44:12.228119 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.227608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58330)
0808 02:44:12.227817 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.227928 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 02:44:12.229367 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.228917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58342)
0808 02:44:12.229153 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.229233 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260808 02:44:12.229594 1588 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
W20260808 02:44:12.297132 1597 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:44:12.297578 1597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:12.297711 1597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:12.297878 1597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 02:44:12.305696 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 4
W20260808 02:44:12.305855 1597 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:12.306022 1597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:12.306143 1597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:12.306234 1597 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:12.306344 1597 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:12.307241 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.306586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58358)
0808 02:44:12.306859 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.307019 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 02:44:12.308256 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.307916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58368)
0808 02:44:12.308070 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.308147 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 02:44:12.308458 1506 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:39455: Network error: Client connection negotiation failed: client connection to 127.10.20.124:39455: connect: Connection refused (error 111)
I20260808 02:44:12.317368 1597 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:45151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:36595,127.10.20.125:33915,127.10.20.124:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab
--principal=kudu/127.10.20.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.20.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:12.318940 1597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:12.320401 1597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:12.334451 1606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:12.334426 1604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:12.335476 1603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:12.335461 1597 server_base.cc:1034] running on GCE node
I20260808 02:44:12.336728 1597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:12.338449 1597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:12.339763 1597 hybrid_clock.cc:648] HybridClock initialized: now 1786157052339676 us; error 101 us; skew 500 ppm
I20260808 02:44:12.340188 1597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157052, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:12.344086 1597 init.cc:377] Logged in from keytab as kudu/127.10.20.124@KRBTEST.COM (short username kudu)
I20260808 02:44:12.345963 1597 webserver.cc:460] Webserver started at http://127.10.20.124:36693/ using document root <none> and password file <none>
I20260808 02:44:12.346812 1597 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:12.346920 1597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:12.347223 1597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:12.350440 1597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data/instance:
uuid: "5dabf80fe7634960a4ee3390b46737d9"
format_stamp: "Formatted at 2026-08-08 02:44:12 on dist-test-slave-8tdl"
server_key: "5d228adb151f5577b99d62f412787f66"
server_key_iv: "addf9f5f48fca2f3f9a45302b16073f5"
server_key_version: "encryptionkey@0"
I20260808 02:44:12.351447 1597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal/instance:
uuid: "5dabf80fe7634960a4ee3390b46737d9"
format_stamp: "Formatted at 2026-08-08 02:44:12 on dist-test-slave-8tdl"
server_key: "5d228adb151f5577b99d62f412787f66"
server_key_iv: "addf9f5f48fca2f3f9a45302b16073f5"
server_key_version: "encryptionkey@0"
I20260808 02:44:12.357421 1597 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 02:44:12.361565 1613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:12.363409 1597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 02:44:12.363631 1597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal
uuid: "5dabf80fe7634960a4ee3390b46737d9"
format_stamp: "Formatted at 2026-08-08 02:44:12 on dist-test-slave-8tdl"
server_key: "5d228adb151f5577b99d62f412787f66"
server_key_iv: "addf9f5f48fca2f3f9a45302b16073f5"
server_key_version: "encryptionkey@0"
I20260808 02:44:12.363889 1597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:12.384114 1597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:12.389729 1597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:12.390278 1597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:12.410733 1597 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.124:39455
I20260808 02:44:12.410773 1669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.124:39455 every 8 connection(s)
I20260808 02:44:12.412254 1597 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
I20260808 02:44:12.416096 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1597
I20260808 02:44:12.416323 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786156633487900-10321-0/minicluster-data/master-2/wal/instance
I20260808 02:44:12.416801 1670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:12.416932 10321 external_mini_cluster.cc:1428] Setting key 7708a0f13f357f5d93b748de3852554c
I20260808 02:44:12.427757 1670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157052, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:44:12.455852 1674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.419044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58382 (local address 127.10.20.124:39455)
0808 02:44:12.419922 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.419939 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.419991 (+ 52us) server_negotiation.cc:407] Connection header received
0808 02:44:12.422581 (+ 2590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.422621 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.423340 (+ 719us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.423864 (+ 524us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.425565 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.427010 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.428470 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.429267 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.429472 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.437137 (+ 7665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.437155 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.437189 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.437287 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.450971 (+ 13684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.451927 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.451945 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.451955 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.452181 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.452613 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.452619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.452624 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.453377 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.453696 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.454199 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.454661 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":366,"threads_started":1}
I20260808 02:44:12.464517 1675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.430452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:36595 (local address 127.0.0.1:36836)
0808 02:44:12.444482 (+ 14030us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.444553 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:12.444772 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:12.446201 (+ 1429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:12.446210 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:12.447833 (+ 1623us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:12.448553 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.448578 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.450700 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.450707 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.452042 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.452058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.453068 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.453074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.453221 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.454012 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:12.454036 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:12.456801 (+ 2765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:12.461600 (+ 4799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.461614 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.461621 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.462200 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.462695 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.462700 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.462704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.462903 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.463507 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:12.463516 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:12.463762 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 02:44:12.463916 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 02:44:12.464212 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13697,"thread_start_us":13378,"threads_started":1}
I20260808 02:44:12.464772 1677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.430561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36836 (local address 127.10.20.126:36595)
0808 02:44:12.445369 (+ 14808us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.445375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.445398 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:44:12.445475 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.445480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.445591 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.445735 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.448892 (+ 3157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.450418 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.452216 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.452808 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.452966 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.457301 (+ 4335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.457308 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.457311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.457353 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.461394 (+ 4041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.462362 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.462367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.462370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.462547 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.463041 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.463045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.463047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.463360 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.463507 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.464097 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.464367 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14639,"thread_start_us":14500,"threads_started":1}
I20260808 02:44:12.466631 1670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157052, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:12.481614 1678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.459454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36850 (local address 127.10.20.126:36595)
0808 02:44:12.460317 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.460322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.460345 (+ 23us) server_negotiation.cc:407] Connection header received
0808 02:44:12.460415 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.460418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.460495 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.460601 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.462271 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.463492 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.465399 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.466128 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.466273 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.472249 (+ 5976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.472342 (+ 93us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.472356 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.472478 (+ 122us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.476921 (+ 4443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.478259 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.478270 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.478274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.478615 (+ 341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.479434 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.479441 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.479444 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.479921 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.480194 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.480834 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.481104 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":464,"threads_started":1}
I20260808 02:44:12.486941 1675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.467857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:33915 (local address 127.0.0.1:47064)
0808 02:44:12.468119 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.468141 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:12.468265 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:12.468874 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:12.468882 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:12.469371 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:12.469533 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.469542 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.471176 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.471183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.472804 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.472829 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.474124 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.474132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.474380 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.475185 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:12.475215 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:12.479125 (+ 3910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:12.483900 (+ 4775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.483906 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.483910 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.484503 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.484972 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.484977 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.484981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.485150 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.485760 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:12.485765 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:12.485935 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 02:44:12.486102 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 02:44:12.486505 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 02:44:12.487092 1679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.467958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47064 (local address 127.10.20.125:33915)
0808 02:44:12.468538 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.468543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.468560 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:44:12.468614 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.468619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.468697 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.468825 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.469744 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.470886 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.473105 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.473789 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.473907 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.479503 (+ 5596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.479510 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.479514 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.479561 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.483709 (+ 4148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.484655 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.484661 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.484665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.484838 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.485310 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.485316 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.485323 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.485632 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.485801 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.486234 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.486499 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":348,"threads_started":1}
I20260808 02:44:12.488255 1670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157052, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:12.504669 1674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.489376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.10.20.124:39455)
0808 02:44:12.489580 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.489586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.489702 (+ 116us) server_negotiation.cc:407] Connection header received
0808 02:44:12.489826 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.489832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.489909 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.490009 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.491040 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.492046 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.493674 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.494343 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.494501 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.498354 (+ 3853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.498362 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.498369 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.498420 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.501446 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.502311 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.502315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.502317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.502432 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.502887 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.502892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.502894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.503304 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.503469 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.503937 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.504215 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 02:44:12.505090 1675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.489385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58396)
0808 02:44:12.489619 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.489635 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:12.489731 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:12.490086 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:12.490090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:12.490591 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:12.490877 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.490890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.492188 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.492193 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.493489 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.493503 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.494887 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.494899 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.495164 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.495828 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:12.495847 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:12.498099 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:12.501608 (+ 3509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.501616 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.501620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.502182 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.502554 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.502562 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.502566 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.502777 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.503470 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:12.503474 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:12.503657 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 02:44:12.503840 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 02:44:12.504434 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":198}
I20260808 02:44:12.506512 1679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.484049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.10.20.125:33915)
0808 02:44:12.487359 (+ 3310us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.487364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.487384 (+ 20us) server_negotiation.cc:407] Connection header received
0808 02:44:12.487428 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.487434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.487494 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.487617 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.489262 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.490320 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.492133 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.492791 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.492973 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.499321 (+ 6348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.499331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.499337 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.499389 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.502649 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.503666 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.503672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.503676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.503937 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.504434 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.504440 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.504443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.504941 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.505236 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.505831 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.506114 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3191,"thread_start_us":2889,"threads_started":1}
I20260808 02:44:12.511025 1670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: Bootstrap starting.
I20260808 02:44:12.512279 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:44:12.514544 1670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:12.515798 1670 log.cc:824] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:12.515219 1481 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3dc78e8b354d4696b717808c6c3920e9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36850
I20260808 02:44:12.519236 1670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: No bootstrap required, opened a new log
I20260808 02:44:12.526983 1670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.527562 1670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dabf80fe7634960a4ee3390b46737d9, State: Initialized, Role: FOLLOWER
I20260808 02:44:12.528095 1670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.528827 1588 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 5
I20260808 02:44:12.529184 1682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.529515 1682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.530615 1670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
I20260808 02:44:12.546666 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.529530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58412)
0808 02:44:12.529967 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.529991 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:12.530130 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:12.530629 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:12.530638 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:12.531230 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:12.531453 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.531469 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.533086 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.533092 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.534244 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.534259 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.535475 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.535481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.535740 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.536396 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:12.536415 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:12.538786 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:12.543820 (+ 5034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.543826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.543831 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.544407 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.544823 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.544828 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.544832 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.544987 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.545597 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:12.545602 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:12.545767 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 02:44:12.545910 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 02:44:12.546261 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280}
I20260808 02:44:12.546715 1674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.529991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.10.20.124:39455)
0808 02:44:12.530196 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.530201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.530220 (+ 19us) server_negotiation.cc:407] Connection header received
0808 02:44:12.530296 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.530300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.530456 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.530550 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.531633 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.532886 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.534407 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.535301 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.535440 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.539102 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.539114 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.539123 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.539190 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.543641 (+ 4451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.544537 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.544545 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.544549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.544700 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.545102 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.545108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.545111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.545472 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.545647 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.546070 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.546287 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 02:44:12.551865 1588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: Bootstrap starting.
W20260808 02:44:12.553792 1694 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:44:12.553946 1694 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:44:12.556252 1588 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:12.557655 1588 log.cc:824] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:12.545948 1597 master_runner.cc:186] Error getting master registration for 127.10.20.126:36595: OK, instance_id { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" instance_seqno: 1786157051135593 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:44:12.559166 1597 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:44:12.561160 1588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: No bootstrap required, opened a new log
I20260808 02:44:12.571630 1588 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.572023 1588 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d04de5ea8643ed91abce8dfbb61784, State: Initialized, Role: FOLLOWER
I20260808 02:44:12.572613 1588 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.573706 1697 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.574139 1697 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.575232 1588 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:12.585673 1506 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } attempt: 5
W20260808 02:44:12.587234 1709 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:44:12.587494 1709 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 08 02:44:12 dist-test-slave-8tdl krb5kdc[1422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157051, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
I20260808 02:44:12.583253 1514 master_runner.cc:186] Error getting master registration for 127.10.20.126:36595: OK, instance_id { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" instance_seqno: 1786157051135593 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:44:12.596849 1514 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:44:12.608685 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.586350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:39455 (local address 127.0.0.1:58426)
0808 02:44:12.586807 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:12.586828 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:12.586963 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:12.587380 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:12.587386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:12.587991 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:12.588301 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.588315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.589878 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.589884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.591461 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:12.591480 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.592947 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.592955 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:12.593168 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.594016 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:12.594058 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:12.597463 (+ 3405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:12.604600 (+ 7137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.604607 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.604612 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.605348 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.606117 (+ 769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:12.606123 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:12.606128 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:12.606339 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:12.607486 (+ 1147us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:12.607493 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:12.607698 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 02:44:12.607855 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 02:44:12.608220 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292}
I20260808 02:44:12.609932 1674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.586801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58426 (local address 127.10.20.124:39455)
0808 02:44:12.586998 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.587006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.587044 (+ 38us) server_negotiation.cc:407] Connection header received
0808 02:44:12.587119 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.587124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.587215 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.587338 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.588487 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.589631 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.591703 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.592444 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.592590 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.597774 (+ 5184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.597783 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.597788 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.597838 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.604307 (+ 6469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.605558 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.605564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.605568 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.605950 (+ 382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.606486 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.606494 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.606500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.607252 (+ 752us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.607588 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.609243 (+ 1655us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.609542 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:44:12.616922 1506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9: Bootstrap starting.
I20260808 02:44:12.621798 1506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:12.623675 1506 log.cc:824] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:12.634275 1506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9: No bootstrap required, opened a new log
W20260808 02:44:12.643446 1619 tablet.cc:2369] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:44:12.644130 1506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.644650 1506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc78e8b354d4696b717808c6c3920e9, State: Initialized, Role: FOLLOWER
I20260808 02:44:12.645431 1506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.646888 1712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.647706 1712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.648247 1506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:12.648336 1481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 02:44:12.648561 1481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:12.652706 1481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.655273 1481 leader_election.cc:288] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [CANDIDATE]: Term 1 election: Requested vote from peers c9d04de5ea8643ed91abce8dfbb61784 (127.10.20.125:33915), 5dabf80fe7634960a4ee3390b46737d9 (127.10.20.124:39455)
I20260808 02:44:12.655668 1560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3dc78e8b354d4696b717808c6c3920e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c9d04de5ea8643ed91abce8dfbb61784"
I20260808 02:44:12.656209 1560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:12.660084 1560 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc78e8b354d4696b717808c6c3920e9 in term 1.
I20260808 02:44:12.661463 1642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3dc78e8b354d4696b717808c6c3920e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5dabf80fe7634960a4ee3390b46737d9"
I20260808 02:44:12.662019 1642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:12.666513 1642 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc78e8b354d4696b717808c6c3920e9 in term 1.
I20260808 02:44:12.667294 1457 leader_election.cc:302] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc78e8b354d4696b717808c6c3920e9, c9d04de5ea8643ed91abce8dfbb61784; no voters:
I20260808 02:44:12.668605 1712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:44:12.682010 1712 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [term 1 LEADER]: Becoming Leader. State: Replica: 3dc78e8b354d4696b717808c6c3920e9, State: Running, Role: LEADER
I20260808 02:44:12.682900 1712 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } }
I20260808 02:44:12.695170 1715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dc78e8b354d4696b717808c6c3920e9. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.695734 1715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:12.706386 1727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:44:12.725548 1727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:44:12.758351 1678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.688258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36856 (local address 127.10.20.126:36595)
0808 02:44:12.688520 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.688528 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.706325 (+ 17797us) server_negotiation.cc:407] Connection header received
0808 02:44:12.707813 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.707820 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.707912 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.707999 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.714871 (+ 6872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.716131 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.726389 (+ 10258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.727231 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.727351 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.743383 (+ 16032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.743392 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.743397 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.743446 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.747661 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.754326 (+ 6665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.754334 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.754338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.754570 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.756039 (+ 1469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.756046 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.756049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.756590 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.756905 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.757629 (+ 724us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.757970 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 02:44:12.760754 1537 tablet.cc:2369] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:44:12.777697 1679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.704933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47080 (local address 127.10.20.125:33915)
0808 02:44:12.705173 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.705181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.720906 (+ 15725us) server_negotiation.cc:407] Connection header received
0808 02:44:12.721340 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.721346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.721455 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.721535 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.732501 (+ 10966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.733788 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.742089 (+ 8301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.742852 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.742977 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.762101 (+ 19124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.762112 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.762118 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.762170 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.766566 (+ 4396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.773461 (+ 6895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.773470 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.773474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.773681 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.775044 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.775051 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.775055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.775574 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.775885 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.776888 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.777195 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 02:44:12.784147 1674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:12.690858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58436 (local address 127.10.20.124:39455)
0808 02:44:12.691126 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:12.691133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:12.720113 (+ 28980us) server_negotiation.cc:407] Connection header received
0808 02:44:12.722191 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:12.722200 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:12.723169 (+ 969us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:12.723261 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:12.738010 (+ 14749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.739366 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.749741 (+ 10375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:12.750540 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:12.750662 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:12.767684 (+ 17022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:12.767694 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:12.767699 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:12.767751 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:12.771928 (+ 4177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.774228 (+ 2300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.774237 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.774245 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.774425 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:12.778349 (+ 3924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:12.778356 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:12.778360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:12.778979 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:12.779259 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:12.783397 (+ 4138us) server_negotiation.cc:299] Negotiation successful
0808 02:44:12.783710 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260808 02:44:12.797817 1642 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [term 1 FOLLOWER]: Refusing update from remote peer 3dc78e8b354d4696b717808c6c3920e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:44:12.803344 1715 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:44:12.825984 1560 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [term 1 FOLLOWER]: Refusing update from remote peer 3dc78e8b354d4696b717808c6c3920e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:44:12.827585 1715 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:44:12.849572 1682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dc78e8b354d4696b717808c6c3920e9. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.849933 1682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.854751 1734 mvcc.cc:205] Tried to move back new op lower bound from 7316099288228691968 to 7316099287796793344. Current Snapshot: MvccSnapshot[applied={T|T < 7316099288228691968}]
I20260808 02:44:12.869529 1682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.869854 1682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.872494 1715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.872820 1715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:12.874950 1727 catalog_manager.cc:1347] Generated new cluster ID: 402db810a2c84fa68f86b9431b54b15b
I20260808 02:44:12.875062 1727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:44:12.876273 1697 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dc78e8b354d4696b717808c6c3920e9. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.876611 1697 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.881232 1712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.881619 1712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9 [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:12.883570 1740 mvcc.cc:205] Tried to move back new op lower bound from 7316099288228691968 to 7316099287796793344. Current Snapshot: MvccSnapshot[applied={T|T < 7316099288228691968}]
I20260808 02:44:12.895640 1697 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3dc78e8b354d4696b717808c6c3920e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc78e8b354d4696b717808c6c3920e9" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 36595 } } peers { permanent_uuid: "c9d04de5ea8643ed91abce8dfbb61784" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 33915 } } peers { permanent_uuid: "5dabf80fe7634960a4ee3390b46737d9" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 39455 } } }
I20260808 02:44:12.895979 1697 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:12.924435 1727 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:44:12.928330 1727 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:44:12.968458 1727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3dc78e8b354d4696b717808c6c3920e9: Generated new TSK 0
I20260808 02:44:12.969841 1727 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:44:13.104780 10321 mini_kdc.cc:348] Time spent kdestroy: real 0.114s user 0.004s sys 0.034s
W20260808 02:44:13.180606 1674 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.146825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58444 (local address 127.10.20.124:39455)
0808 02:44:13.147051 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.147059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.178004 (+ 30945us) server_negotiation.cc:407] Connection header received
0808 02:44:13.178507 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.178515 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.178652 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.178780 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.180266 (+ 1486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58444: BlockingRecv error: recv got EOF from 127.0.0.1:58444 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 02:44:13.183054 1678 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.143315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36864 (local address 127.10.20.126:36595)
0808 02:44:13.143571 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.143580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.177162 (+ 33582us) server_negotiation.cc:407] Connection header received
0808 02:44:13.181139 (+ 3977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.181149 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.181261 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.181355 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.182759 (+ 1404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36864: BlockingRecv error: recv got EOF from 127.0.0.1:36864 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260808 02:44:13.192838 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.171477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47084 (local address 127.10.20.125:33915)
0808 02:44:13.171747 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.171754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.183977 (+ 12223us) server_negotiation.cc:407] Connection header received
0808 02:44:13.190842 (+ 6865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.190850 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.190985 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.191084 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.192536 (+ 1452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47084: BlockingRecv error: recv got EOF from 127.0.0.1:47084 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260808 02:44:13.237833 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.225731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47100 (local address 127.10.20.125:33915)
0808 02:44:13.225945 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.225958 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.235266 (+ 9308us) server_negotiation.cc:407] Connection header received
0808 02:44:13.235889 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.235896 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.236056 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.236157 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.237516 (+ 1359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47100: BlockingRecv error: recv got EOF from 127.0.0.1:47100 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 02:44:13.272775 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.270090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47116 (local address 127.10.20.125:33915)
0808 02:44:13.270422 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.270432 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.271111 (+ 679us) server_negotiation.cc:407] Connection header received
0808 02:44:13.271364 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.271370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.271488 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.271612 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.272506 (+ 894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47116: BlockingRecv error: recv got EOF from 127.0.0.1:47116 (error 108)
Metrics: {"server-negotiator.queue_time_us":138}
W20260808 02:44:13.281069 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.278460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47128 (local address 127.10.20.125:33915)
0808 02:44:13.278753 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.278763 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.279420 (+ 657us) server_negotiation.cc:407] Connection header received
0808 02:44:13.279666 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.279678 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.279757 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.279875 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.280723 (+ 848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47128: BlockingRecv error: recv got EOF from 127.0.0.1:47128 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 02:44:13.291342 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.288660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.10.20.125:33915)
0808 02:44:13.289060 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.289070 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.289620 (+ 550us) server_negotiation.cc:407] Connection header received
0808 02:44:13.289921 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.289932 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.290009 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.290119 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.291085 (+ 966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47132: BlockingRecv error: recv got EOF from 127.0.0.1:47132 (error 108)
Metrics: {"server-negotiator.queue_time_us":160}
W20260808 02:44:13.306888 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.303158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47138 (local address 127.10.20.125:33915)
0808 02:44:13.303409 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.303419 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.303974 (+ 555us) server_negotiation.cc:407] Connection header received
0808 02:44:13.304266 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.304271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.304372 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.304486 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.306463 (+ 1977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47138: BlockingRecv error: recv got EOF from 127.0.0.1:47138 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 02:44:13.330152 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.327798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47150 (local address 127.10.20.125:33915)
0808 02:44:13.328060 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.328068 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.328544 (+ 476us) server_negotiation.cc:407] Connection header received
0808 02:44:13.328803 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.328807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.328890 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.329000 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.329889 (+ 889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47150: BlockingRecv error: recv got EOF from 127.0.0.1:47150 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
W20260808 02:44:13.369419 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.367014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47158 (local address 127.10.20.125:33915)
0808 02:44:13.367277 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.367285 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.367626 (+ 341us) server_negotiation.cc:407] Connection header received
0808 02:44:13.367813 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.367819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.367936 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.368120 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.369086 (+ 966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47158: BlockingRecv error: recv got EOF from 127.0.0.1:47158 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260808 02:44:13.440078 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.437659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47170 (local address 127.10.20.125:33915)
0808 02:44:13.437920 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.437932 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.438218 (+ 286us) server_negotiation.cc:407] Connection header received
0808 02:44:13.438425 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.438430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.438529 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.438647 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.439831 (+ 1184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47170: BlockingRecv error: recv got EOF from 127.0.0.1:47170 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 02:44:13.556414 1694 catalog_manager.cc:1259] Loaded cluster ID: 402db810a2c84fa68f86b9431b54b15b
I20260808 02:44:13.556567 1694 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: loading cluster ID for follower catalog manager: success
I20260808 02:44:13.559719 1694 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: acquiring CA information for follower catalog manager: success
I20260808 02:44:13.561794 1694 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5dabf80fe7634960a4ee3390b46737d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 02:44:13.574240 1679 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:13.572131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47186 (local address 127.10.20.125:33915)
0808 02:44:13.572396 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.572404 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.572721 (+ 317us) server_negotiation.cc:407] Connection header received
0808 02:44:13.573007 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.573012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.573098 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.573211 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:13.574055 (+ 844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47186: BlockingRecv error: recv got EOF from 127.0.0.1:47186 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:44:13.589702 1709 catalog_manager.cc:1259] Loaded cluster ID: 402db810a2c84fa68f86b9431b54b15b
I20260808 02:44:13.589850 1709 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: loading cluster ID for follower catalog manager: success
I20260808 02:44:13.592592 1709 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: acquiring CA information for follower catalog manager: success
I20260808 02:44:13.594573 1709 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c9d04de5ea8643ed91abce8dfbb61784: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:44:13.840695 1679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:13.834726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47196 (local address 127.10.20.125:33915)
0808 02:44:13.834979 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.834987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.835283 (+ 296us) server_negotiation.cc:407] Connection header received
0808 02:44:13.835551 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.835555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.835744 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.835875 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:13.836351 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.837077 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.838460 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.838892 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.839035 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:13.839542 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:13.840077 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:13.840238 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:13.840319 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 02:44:13.840409 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 02:44:13.853583 1817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:13.847252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.10.20.124:39455)
0808 02:44:13.847780 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.847785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.847807 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:44:13.848048 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.848053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.848240 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.848432 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:13.848845 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.849799 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.851236 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.851645 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.851785 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:13.852300 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:13.852895 (+ 595us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:13.853054 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:13.853156 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 02:44:13.853245 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":275,"threads_started":1}
I20260808 02:44:13.871047 1817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:13.861370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.10.20.124:39455)
0808 02:44:13.861580 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.861589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.863278 (+ 1689us) server_negotiation.cc:407] Connection header received
0808 02:44:13.863478 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.863483 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.863584 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.863786 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:13.864709 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.865765 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.868649 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.869273 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.869423 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:13.870103 (+ 680us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:13.870270 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:13.870366 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:13.870599 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 02:44:13.870712 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 02:44:13.871134 1679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:13.861136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47202 (local address 127.10.20.125:33915)
0808 02:44:13.861395 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.861404 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.862812 (+ 1408us) server_negotiation.cc:407] Connection header received
0808 02:44:13.863208 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.863214 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.863324 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.863447 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:13.864373 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.865491 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.868559 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.869596 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.869738 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:13.870247 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:13.870383 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:13.870472 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:13.870664 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 02:44:13.870774 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 02:44:13.871500 1822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:13.860874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36870 (local address 127.10.20.126:36595)
0808 02:44:13.862617 (+ 1743us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:13.862624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:13.862649 (+ 25us) server_negotiation.cc:407] Connection header received
0808 02:44:13.863036 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:13.863045 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:13.863325 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:13.863512 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:13.864241 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.865490 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.867956 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:13.868834 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:13.869246 (+ 412us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:13.869824 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:13.870343 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:13.870457 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:13.871038 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 02:44:13.871145 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":617,"threads_started":1}
I20260808 02:44:13.882812 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1436
I20260808 02:44:13.884264 1501 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:14.000694 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1436
W20260808 02:44:14.026796 1617 connection.cc:535] server connection from 127.0.0.1:58426 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 02:44:14.027227 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1514
I20260808 02:44:14.028625 1583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:14.145625 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1514
I20260808 02:44:14.170516 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1597
I20260808 02:44:14.171738 1663 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:14.283368 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1597
2026-08-08T02:44:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5373 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 02:44:14 dist-test-slave-8tdl krb5kdc[1832](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 02:44:14 dist-test-slave-8tdl krb5kdc[1832](info): set up 2 sockets
Aug 08 02:44:14 dist-test-slave-8tdl krb5kdc[1832](info): commencing operation
krb5kdc: starting...
W20260808 02:44:15.511932 10321 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/test-user.keytab.
Aug 08 02:44:15 dist-test-slave-8tdl krb5kdc[1832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T02:44:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T02:44:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.20.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
Entry for principal kudu/127.10.20.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab.
I20260808 02:44:15.930073 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:41019
--webserver_interface=127.10.20.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:41019,127.10.20.125:41143,127.10.20.124:45219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 02:44:16.331810 1845 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:44:16.332283 1845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:16.332388 1845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:16.332512 1845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:16.340400 1845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:16.340528 1845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:16.340636 1845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:16.340729 1845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:16.340840 1845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:16.351987 1845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:41019,127.10.20.125:41143,127.10.20.124:45219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.126.keytab
--principal=kudu/127.10.20.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.126:41019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.20.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:16.353540 1845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:16.355696 1845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:16.369376 1850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:16.369359 1854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:16.369310 1851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:16.370275 1845 server_base.cc:1034] running on GCE node
I20260808 02:44:16.371296 1845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:16.372988 1845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:16.374264 1845 hybrid_clock.cc:648] HybridClock initialized: now 1786157056374169 us; error 62 us; skew 500 ppm
I20260808 02:44:16.374788 1845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:16 dist-test-slave-8tdl krb5kdc[1832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:16.378479 1845 init.cc:377] Logged in from keytab as kudu/127.10.20.126@KRBTEST.COM (short username kudu)
I20260808 02:44:16.380402 1845 webserver.cc:460] Webserver started at http://127.10.20.126:44077/ using document root <none> and password file <none>
I20260808 02:44:16.381188 1845 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:16.381291 1845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:16.381584 1845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:16.385059 1845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data/instance:
uuid: "5af2bfe1d2a245f0a8da8363fc075a7b"
format_stamp: "Formatted at 2026-08-08 02:44:16 on dist-test-slave-8tdl"
server_key: "48c8644537cf3719f2522eb5c74b9cb1"
server_key_iv: "11a062d4c9104e25ca0ae1860ffda54b"
server_key_version: "encryptionkey@0"
I20260808 02:44:16.385982 1845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal/instance:
uuid: "5af2bfe1d2a245f0a8da8363fc075a7b"
format_stamp: "Formatted at 2026-08-08 02:44:16 on dist-test-slave-8tdl"
server_key: "48c8644537cf3719f2522eb5c74b9cb1"
server_key_iv: "11a062d4c9104e25ca0ae1860ffda54b"
server_key_version: "encryptionkey@0"
I20260808 02:44:16.392340 1845 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 02:44:16.396622 1862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:16.398310 1845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 02:44:16.398553 1845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal
uuid: "5af2bfe1d2a245f0a8da8363fc075a7b"
format_stamp: "Formatted at 2026-08-08 02:44:16 on dist-test-slave-8tdl"
server_key: "48c8644537cf3719f2522eb5c74b9cb1"
server_key_iv: "11a062d4c9104e25ca0ae1860ffda54b"
server_key_version: "encryptionkey@0"
I20260808 02:44:16.398885 1845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:16.444244 1845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:16.450210 1845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:16.450558 1845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:16.473773 1845 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.126:41019
I20260808 02:44:16.473788 1915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.126:41019 every 8 connection(s)
I20260808 02:44:16.475600 1845 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/data/info.pb
I20260808 02:44:16.480106 1916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:16.485494 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1845
I20260808 02:44:16.485733 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-0/wal/instance
I20260808 02:44:16.486231 10321 external_mini_cluster.cc:1428] Setting key 62e24e6f1de51d33d878049fed61b69b
I20260808 02:44:16.487620 1916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:16 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:44:16.515233 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.491360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:41019 (local address 127.0.0.1:56734)
0808 02:44:16.492596 (+ 1236us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.492662 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:16.494662 (+ 2000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:16.495867 (+ 1205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:16.495872 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:16.496516 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:16.496963 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:16.496987 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:16.499515 (+ 2528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:16.499526 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:16.500824 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:16.500847 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:16.502440 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:16.502449 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:16.502592 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:16.503493 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:16.503534 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:16.506192 (+ 2658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:16.510245 (+ 4053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:16.510261 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:16.510275 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:16.510819 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:16.511284 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:16.511290 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:16.511293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:16.511468 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:16.512335 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:16.512348 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:16.512632 (+ 284us) client_negotiation.cc:769] Sending connection context
0808 02:44:16.512921 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 02:44:16.513687 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":229,"thread_start_us":414,"threads_started":1}
I20260808 02:44:16.515267 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.491360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56734 (local address 127.10.20.126:41019)
0808 02:44:16.493174 (+ 1814us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:16.493184 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:16.493243 (+ 59us) server_negotiation.cc:407] Connection header received
0808 02:44:16.495190 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:16.495202 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:16.495570 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:16.495804 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:16.497224 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:16.499308 (+ 2084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:16.501026 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:16.502071 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:16.502286 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:16.506481 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:16.506490 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:16.506505 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:16.506537 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:16.510039 (+ 3502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:16.510982 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:16.510992 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:16.510995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:16.511164 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:16.511593 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:16.511603 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:16.511605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:16.512186 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:16.512431 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:16.513060 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 02:44:16.513555 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":1583,"spinlock_wait_cycles":51968,"thread_start_us":1348,"threads_started":1}
I20260808 02:44:16.519047 1916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:44:16.520615 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.520121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38738)
0808 02:44:16.520325 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.520471 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 02:44:16.520973 1863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
I20260808 02:44:16.522856 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.522338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38744)
0808 02:44:16.522502 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.522583 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:44:16.523123 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:41143: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.10.20.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.125@KRBTEST.COM" created.
I20260808 02:44:16.572522 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } attempt: 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab.
Entry for principal kudu/127.10.20.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab.
I20260808 02:44:16.574146 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.573533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38752)
0808 02:44:16.573794 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.573997 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 02:44:16.574545 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:41143
--webserver_interface=127.10.20.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab
--principal=kudu/127.10.20.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:41019,127.10.20.125:41143,127.10.20.124:45219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:44:16.575533 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.575125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38764)
0808 02:44:16.575288 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.575376 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 02:44:16.575769 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:41143: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
I20260808 02:44:16.644119 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } attempt: 2
I20260808 02:44:16.645504 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.644867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38772)
0808 02:44:16.645173 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.645295 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 02:44:16.646822 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.646308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38780)
0808 02:44:16.646499 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.646596 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 02:44:16.647082 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:41143: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
I20260808 02:44:16.738405 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } attempt: 3
I20260808 02:44:16.739833 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.739321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38786)
0808 02:44:16.739581 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.739682 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 02:44:16.741405 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.740812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38790)
0808 02:44:16.741104 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.741201 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260808 02:44:16.741716 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:41143: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
I20260808 02:44:16.885015 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } attempt: 4
I20260808 02:44:16.886624 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.885984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38806)
0808 02:44:16.886362 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.886462 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
I20260808 02:44:16.888190 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:16.887700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38810)
0808 02:44:16.887937 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:16.888041 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 02:44:16.888496 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.125:41143: Network error: Client connection negotiation failed: client connection to 127.10.20.125:41143: connect: Connection refused (error 111)
W20260808 02:44:16.951717 1923 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:44:16.952191 1923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:16.952323 1923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:16.952466 1923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:16.960801 1923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:16.960994 1923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:16.961136 1923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:16.961225 1923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:16.961337 1923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:16.972419 1923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:41019,127.10.20.125:41143,127.10.20.124:45219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.125.keytab
--principal=kudu/127.10.20.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.125:41143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.20.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:16.973912 1923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:16.975463 1923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:16.989423 1928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:16.989320 1931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:16.989451 1929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:16.991042 1923 server_base.cc:1034] running on GCE node
I20260808 02:44:16.992018 1923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:16.993700 1923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:16.994956 1923 hybrid_clock.cc:648] HybridClock initialized: now 1786157056994841 us; error 78 us; skew 500 ppm
I20260808 02:44:16.995368 1923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:16 dist-test-slave-8tdl krb5kdc[1832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:16.999311 1923 init.cc:377] Logged in from keytab as kudu/127.10.20.125@KRBTEST.COM (short username kudu)
I20260808 02:44:17.001381 1923 webserver.cc:460] Webserver started at http://127.10.20.125:41235/ using document root <none> and password file <none>
I20260808 02:44:17.002282 1923 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:17.002408 1923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:17.002930 1923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:17.006928 1923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data/instance:
uuid: "c32374ec438f4fb1a107ac437307b8ee"
format_stamp: "Formatted at 2026-08-08 02:44:16 on dist-test-slave-8tdl"
server_key: "a6264cf065f31378b7ec0743165b1323"
server_key_iv: "2456c4a2cd92809ceb7888abde1078d1"
server_key_version: "encryptionkey@0"
I20260808 02:44:17.008021 1923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal/instance:
uuid: "c32374ec438f4fb1a107ac437307b8ee"
format_stamp: "Formatted at 2026-08-08 02:44:16 on dist-test-slave-8tdl"
server_key: "a6264cf065f31378b7ec0743165b1323"
server_key_iv: "2456c4a2cd92809ceb7888abde1078d1"
server_key_version: "encryptionkey@0"
I20260808 02:44:17.014886 1923 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:44:17.019380 1939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:17.021167 1923 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 02:44:17.021427 1923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal
uuid: "c32374ec438f4fb1a107ac437307b8ee"
format_stamp: "Formatted at 2026-08-08 02:44:16 on dist-test-slave-8tdl"
server_key: "a6264cf065f31378b7ec0743165b1323"
server_key_iv: "2456c4a2cd92809ceb7888abde1078d1"
server_key_version: "encryptionkey@0"
I20260808 02:44:17.021720 1923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:17.039520 1923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:17.044867 1923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:17.045199 1923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:17.073364 1923 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.125:41143
I20260808 02:44:17.073375 1994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.125:41143 every 8 connection(s)
I20260808 02:44:17.075078 1923 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/data/info.pb
I20260808 02:44:17.077077 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 1923
I20260808 02:44:17.077322 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-1/wal/instance
I20260808 02:44:17.077785 10321 external_mini_cluster.cc:1428] Setting key 8c0c66da4fd939529dc62d693c713909
I20260808 02:44:17.079682 1995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:17.087052 1995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:44:17.115433 1997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.090544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56748 (local address 127.10.20.126:41019)
0808 02:44:17.091198 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.091208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.092417 (+ 1209us) server_negotiation.cc:407] Connection header received
0808 02:44:17.094907 (+ 2490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.094916 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.095035 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.095212 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.097696 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.098600 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.101567 (+ 2967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.102052 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.102227 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.107828 (+ 5601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.107834 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.107838 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.107901 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.111340 (+ 3439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.112419 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.112434 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.112437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.112657 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.113204 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.113212 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.113215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.113585 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.113772 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.114629 (+ 857us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.114988 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":335,"threads_started":1}
WARNING: no policy specified for kudu/127.10.20.124@KRBTEST.COM; defaulting to no policy
I20260808 02:44:17.116657 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.091294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:41019 (local address 127.0.0.1:56748)
0808 02:44:17.092184 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.092236 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.094454 (+ 2218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.095509 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.095519 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.096456 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.097387 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.097420 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.098940 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.098949 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.101309 (+ 2360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.101344 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.102406 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.102440 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.102921 (+ 481us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.103987 (+ 1066us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.104025 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.107436 (+ 3411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.111581 (+ 4145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.111594 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.111625 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.112251 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.112800 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.112806 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.112810 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.113058 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.113747 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.113756 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.114198 (+ 442us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.114534 (+ 336us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.115251 (+ 717us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":361,"threads_started":1}
I20260808 02:44:17.118801 1995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.20.124@KRBTEST.COM" created.
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:17.140868 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.119719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38826)
0808 02:44:17.119997 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.120017 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.120121 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.121384 (+ 1263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.121392 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.122038 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.122291 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.122310 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.124018 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.124025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.125710 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.125734 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.127376 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.127386 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.127679 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.128444 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.128476 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.131920 (+ 3444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.137456 (+ 5536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.137465 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.137470 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.138061 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.138628 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.138635 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.138641 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.138858 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.139677 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.139685 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.139887 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.140126 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.140523 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260808 02:44:17.141598 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.120168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38826 (local address 127.10.20.125:41143)
0808 02:44:17.120898 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.120904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.120934 (+ 30us) server_negotiation.cc:407] Connection header received
0808 02:44:17.120981 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.120986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.121188 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.121312 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.122556 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.123861 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.125927 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.127189 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.127320 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.132317 (+ 4997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.132343 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.132367 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.132424 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.137236 (+ 4812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.138257 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.138270 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.138276 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.138480 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.139005 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.139009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.139014 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.139412 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.139603 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.140263 (+ 660us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.140765 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":195,"server-negotiator.queue_time_us":579,"thread_start_us":434,"threads_started":1}
I20260808 02:44:17.144476 1995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:44:17.146176 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.145521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53142)
0808 02:44:17.145777 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.145988 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 02:44:17.146550 1942 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.148533 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.148136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53148)
0808 02:44:17.148316 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.148405 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 02:44:17.148818 1995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.20.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab.
Entry for principal kudu/127.10.20.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab.
I20260808 02:44:17.171895 10321 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
/tmp/dist-test-tasksj7NWU/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:45219
--webserver_interface=127.10.20.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab
--principal=kudu/127.10.20.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.20.84:36401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.20.126:41019,127.10.20.125:41143,127.10.20.124:45219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 02:44:17.187808 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } attempt: 5
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:17.198190 1995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 1
I20260808 02:44:17.199637 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.199016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53160)
0808 02:44:17.199285 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.199384 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 02:44:17.201021 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.200503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53170)
0808 02:44:17.200728 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.200840 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 02:44:17.201367 1995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.204347 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.188803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38834 (local address 127.10.20.125:41143)
0808 02:44:17.189093 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.189100 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.189126 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:44:17.189338 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.189343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.189417 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.189538 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.190438 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.191254 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.192469 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.192937 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.193090 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.197448 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.197455 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.197458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.197498 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.201223 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.202176 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.202182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.202186 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.202328 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.202799 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.202804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.202808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.203170 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.203351 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.203753 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.204010 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 02:44:17.204365 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.188697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38834)
0808 02:44:17.188943 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.188967 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.189152 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.189627 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.189632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.190064 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.190265 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.190275 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.191410 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.191422 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.192297 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.192311 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.193128 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.193136 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.193347 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.194122 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.194142 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.197128 (+ 2986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.201515 (+ 4387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.201522 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.201526 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.202029 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.202455 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.202461 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.202464 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.202624 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.203293 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.203298 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.203480 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.203637 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.204019 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 02:44:17.205641 1916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } has no permanent_uuid. Determining permanent_uuid...
I20260808 02:44:17.207253 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.206635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53182)
0808 02:44:17.206898 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.207023 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 02:44:17.208732 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.208191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53198)
0808 02:44:17.208409 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.208543 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 02:44:17.209043 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.260339 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 1
I20260808 02:44:17.261914 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.261309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53204)
0808 02:44:17.261561 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.261683 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 02:44:17.263329 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.262899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53212)
0808 02:44:17.263077 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.263175 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 02:44:17.263628 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.269630 1995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 2
I20260808 02:44:17.270978 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.270373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53216)
0808 02:44:17.270620 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.270755 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 02:44:17.272254 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.271786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53224)
0808 02:44:17.271976 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.272072 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260808 02:44:17.272588 1995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.331908 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 2
I20260808 02:44:17.333334 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.332710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53228)
0808 02:44:17.332987 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.333108 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 02:44:17.334995 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.334416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53234)
0808 02:44:17.334628 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.334781 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 02:44:17.335274 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.363862 1995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 3
I20260808 02:44:17.365350 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.364714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53248)
0808 02:44:17.364996 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.365142 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 02:44:17.366750 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.366187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53258)
0808 02:44:17.366455 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.366560 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260808 02:44:17.367053 1995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.441593 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 3
I20260808 02:44:17.443176 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.442478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53270)
0808 02:44:17.442789 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.442921 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 02:44:17.444623 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.444060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53280)
0808 02:44:17.444328 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.444448 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260808 02:44:17.444929 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.510334 1995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 4
I20260808 02:44:17.511969 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.511258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53292)
0808 02:44:17.511625 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.511748 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260808 02:44:17.513326 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.512854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53300)
0808 02:44:17.513051 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.513156 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 02:44:17.513667 1995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
W20260808 02:44:17.559331 2003 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 02:44:17.559746 2003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 02:44:17.559859 2003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 02:44:17.560017 2003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 02:44:17.567662 2003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 02:44:17.567770 2003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 02:44:17.567864 2003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 02:44:17.567950 2003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 02:44:17.568034 2003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 02:44:17.578998 2003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.20.84:36401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.20.126:41019,127.10.20.125:41143,127.10.20.124:45219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/krb5kdc/kudu_127.10.20.124.keytab
--principal=kudu/127.10.20.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.20.124:45219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.20.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 01:07:42 UTC on ccycloud.quasar-vfhkhu.root.comops.site
build id 4573758
ASAN enabled
I20260808 02:44:17.580497 2003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 02:44:17.582055 2003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 02:44:17.595692 2011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:17.595734 2009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 02:44:17.596102 2008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 02:44:17.597728 2003 server_base.cc:1034] running on GCE node
I20260808 02:44:17.598614 2003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 02:44:17.600227 2003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 02:44:17.601468 2003 hybrid_clock.cc:648] HybridClock initialized: now 1786157057601398 us; error 38 us; skew 500 ppm
I20260808 02:44:17.601799 2003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157057, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 02:44:17.605290 2003 init.cc:377] Logged in from keytab as kudu/127.10.20.124@KRBTEST.COM (short username kudu)
I20260808 02:44:17.607092 2003 webserver.cc:460] Webserver started at http://127.10.20.124:37893/ using document root <none> and password file <none>
I20260808 02:44:17.607820 2003 fs_manager.cc:359] Metadata directory not provided
I20260808 02:44:17.607916 2003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 02:44:17.608199 2003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 02:44:17.611480 2003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data/instance:
uuid: "aedb9d7fabae415fbe7eee7da87925c1"
format_stamp: "Formatted at 2026-08-08 02:44:17 on dist-test-slave-8tdl"
server_key: "747879159a2120872fe599ff3a4a0c50"
server_key_iv: "4eeb0d4c2fd1062963ec29663a7384df"
server_key_version: "encryptionkey@0"
I20260808 02:44:17.612308 2003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal/instance:
uuid: "aedb9d7fabae415fbe7eee7da87925c1"
format_stamp: "Formatted at 2026-08-08 02:44:17 on dist-test-slave-8tdl"
server_key: "747879159a2120872fe599ff3a4a0c50"
server_key_iv: "4eeb0d4c2fd1062963ec29663a7384df"
server_key_version: "encryptionkey@0"
I20260808 02:44:17.618644 2003 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 02:44:17.622255 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 4
I20260808 02:44:17.622905 2018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 02:44:17.623606 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.623112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53316)
0808 02:44:17.623298 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.623407 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 02:44:17.624851 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.624410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53322)
0808 02:44:17.624592 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.624686 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 02:44:17.625013 2003 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
W20260808 02:44:17.625144 1916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.20.124:45219: Network error: Client connection negotiation failed: client connection to 127.10.20.124:45219: connect: Connection refused (error 111)
I20260808 02:44:17.625249 2003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data,/tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal
uuid: "aedb9d7fabae415fbe7eee7da87925c1"
format_stamp: "Formatted at 2026-08-08 02:44:17 on dist-test-slave-8tdl"
server_key: "747879159a2120872fe599ff3a4a0c50"
server_key_iv: "4eeb0d4c2fd1062963ec29663a7384df"
server_key_version: "encryptionkey@0"
I20260808 02:44:17.625486 2003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 02:44:17.639416 2003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 02:44:17.644173 2003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 02:44:17.644428 2003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 02:44:17.665323 2003 rpc_server.cc:307] RPC server started. Bound to: 127.10.20.124:45219
I20260808 02:44:17.665361 2072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.20.124:45219 every 8 connection(s)
I20260808 02:44:17.666965 2003 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/data/info.pb
I20260808 02:44:17.667714 10321 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu as pid 2003
I20260808 02:44:17.667935 10321 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksj7NWU/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786156633487900-10321-0/minicluster-data/master-2/wal/instance
I20260808 02:44:17.668570 10321 external_mini_cluster.cc:1428] Setting key 5e52533fb00b0aad05cfb3d51060267a
I20260808 02:44:17.672307 2073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 02:44:17.681715 2073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157057, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
I20260808 02:44:17.696679 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.670489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.10.20.124:45219)
0808 02:44:17.671627 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.671643 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.671695 (+ 52us) server_negotiation.cc:407] Connection header received
0808 02:44:17.674122 (+ 2427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.674153 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.674725 (+ 572us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.675244 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.676986 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.679180 (+ 2194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.680679 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.681747 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.681982 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.687557 (+ 5575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.687569 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.687580 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.687625 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.691406 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.692270 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.692296 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.692304 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.692651 (+ 347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.693150 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.693157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.693161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.693790 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.694153 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.694651 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.695197 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":684,"threads_started":1}
I20260808 02:44:17.702647 2077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.685323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56762 (local address 127.10.20.126:41019)
0808 02:44:17.685912 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.685920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.686514 (+ 594us) server_negotiation.cc:407] Connection header received
0808 02:44:17.686796 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.686803 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.686909 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.687057 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.688766 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.689534 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.691254 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.691688 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.691837 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.695667 (+ 3830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.695676 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.695681 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.695734 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.699104 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.699975 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.699980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.699983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.700210 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.700761 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.700765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.700769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.701214 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.701388 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.702134 (+ 746us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.702317 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":273,"threads_started":1}
I20260808 02:44:17.702862 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.685324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.126:41019 (local address 127.0.0.1:56762)
0808 02:44:17.686346 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.686391 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.686592 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.687226 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.687233 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.688099 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.688557 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.688582 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.689730 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.689736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.691038 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.691059 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.691913 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.691919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.692108 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.692792 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.692811 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.695411 (+ 2600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.699256 (+ 3845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.699267 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.699277 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.699818 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.700364 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.700368 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.700371 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.700592 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.701455 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.701464 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.701711 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.701956 (+ 245us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.702365 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"thread_start_us":569,"threads_started":1}
I20260808 02:44:17.704725 2073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.126@KRBTEST.COM
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157057, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:17.719298 2079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.700236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56778 (local address 127.10.20.126:41019)
0808 02:44:17.700941 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.700946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.700970 (+ 24us) server_negotiation.cc:407] Connection header received
0808 02:44:17.701045 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.701050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.701140 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.701257 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.703274 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.704588 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.706552 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.707093 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.707249 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.712560 (+ 5311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.712566 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.712569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.712609 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.715850 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.716801 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.716807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.716812 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.717064 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.717562 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.717567 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.717569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.717968 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.718265 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.718538 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.718835 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":304,"threads_started":1}
I20260808 02:44:17.722198 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.705687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.125:41143 (local address 127.0.0.1:38838)
0808 02:44:17.705857 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.705878 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.705977 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.707230 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.707235 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.707667 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.707823 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.707831 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.708978 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.708986 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.710560 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.710580 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.711686 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.711692 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.711842 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.712519 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.712543 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.714916 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.718960 (+ 4044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.718967 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.718971 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.719552 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.719988 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.719994 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.719997 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.720150 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.720873 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.720901 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.721116 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.721360 (+ 244us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.721721 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 02:44:17.723464 2080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.705702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38838 (local address 127.10.20.125:41143)
0808 02:44:17.706936 (+ 1234us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.706940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.706957 (+ 17us) server_negotiation.cc:407] Connection header received
0808 02:44:17.707005 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.707009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.707069 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.707161 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.708029 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.708745 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.710808 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.711305 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.711490 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.715172 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.715182 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.715190 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.715240 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.718773 (+ 3533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.719692 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.719697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.719701 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.719856 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.720295 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.720301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.720304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.720680 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.720840 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.722566 (+ 1726us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.722895 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1122,"thread_start_us":1000,"threads_started":1}
I20260808 02:44:17.724932 2073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157057, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.124@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.20.125@KRBTEST.COM
I20260808 02:44:17.742807 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.726098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53342)
0808 02:44:17.726311 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.726344 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.726462 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.727227 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.727231 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.727948 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.728078 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.728086 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.729337 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.729342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.730603 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.730822 (+ 219us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.732144 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.732150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.732383 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.733108 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.733139 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.735998 (+ 2859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.740043 (+ 4045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.740047 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.740051 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.740491 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.740922 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.740928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.740931 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.741067 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.741681 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.741685 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.741910 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.742093 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.742424 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 02:44:17.743372 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.726521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53342 (local address 127.10.20.124:45219)
0808 02:44:17.726767 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.726803 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.726824 (+ 21us) server_negotiation.cc:407] Connection header received
0808 02:44:17.726928 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.726935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.727061 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.727679 (+ 618us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.728218 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.729192 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.730978 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.731706 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.731840 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.736198 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.736204 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.736210 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.736249 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.739788 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.740635 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.740641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.740644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.740813 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.741175 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.741183 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.741186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.741538 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.741697 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.742180 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.742647 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":157,"server-negotiator.queue_time_us":75}
I20260808 02:44:17.744519 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.721569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38846 (local address 127.10.20.125:41143)
0808 02:44:17.722526 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.722534 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.722650 (+ 116us) server_negotiation.cc:407] Connection header received
0808 02:44:17.722922 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.722930 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.723040 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.723175 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.725511 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.727018 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.729281 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.730067 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.730220 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.737013 (+ 6793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.737024 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.737030 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.737081 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.740695 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.741560 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.741569 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.741575 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.741757 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.742283 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.742291 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.742295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.742718 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.743000 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.743825 (+ 825us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.744103 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":374,"threads_started":1}
I20260808 02:44:17.749704 2073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: Bootstrap starting.
I20260808 02:44:17.750440 10321 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 02:44:17.754005 2073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:17.755370 2073 log.cc:824] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:17.754004 1889 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56778
I20260808 02:44:17.759074 2073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: No bootstrap required, opened a new log
I20260808 02:44:17.767148 2073 raft_consensus.cc:348] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.767575 2073 raft_consensus.cc:729] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedb9d7fabae415fbe7eee7da87925c1, State: Initialized, Role: FOLLOWER
I20260808 02:44:17.768076 2073 consensus_queue.cc:260] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.769263 2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:17.769695 2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:17.770292 2073 sys_catalog.cc:564] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:44:17.780773 2095 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:44:17.780997 2095 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:44:17.778607 2003 master_runner.cc:186] Error getting master registration for 127.10.20.126:41019: OK, instance_id { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" instance_seqno: 1786157056466471 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:44:17.790869 2003 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 02:44:17.812952 1995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 5
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.125@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
I20260808 02:44:17.829500 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.813764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53352)
0808 02:44:17.813988 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.814014 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.814156 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.814551 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.814557 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.815078 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.815289 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.815301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.816458 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.816464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.817458 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.817473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.818331 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.818339 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.818564 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.819357 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.819377 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.821887 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.826288 (+ 4401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.826294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.826299 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.826998 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.827464 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.827469 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.827474 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.827656 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.828311 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.828317 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.828506 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.828671 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.829086 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 02:44:17.829497 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.813860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53352 (local address 127.10.20.124:45219)
0808 02:44:17.814154 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.814160 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.814182 (+ 22us) server_negotiation.cc:407] Connection header received
0808 02:44:17.814295 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.814301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.814373 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.814489 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.815483 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.816288 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.817640 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.818135 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.818289 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.822218 (+ 3929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.822225 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.822228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.822269 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.826082 (+ 3813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.827143 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.827152 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.827158 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.827325 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.827809 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.827817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.827821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.828189 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.828368 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.828818 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.829103 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260808 02:44:17.836216 1995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: Bootstrap starting.
I20260808 02:44:17.840466 1995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:17.841847 1995 log.cc:824] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:17.845718 1995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: No bootstrap required, opened a new log
I20260808 02:44:17.857645 1995 raft_consensus.cc:348] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.858147 1995 raft_consensus.cc:729] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c32374ec438f4fb1a107ac437307b8ee, State: Initialized, Role: FOLLOWER
I20260808 02:44:17.858744 1995 consensus_queue.cc:260] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.859922 2099 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:17.860368 2099 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:17.861326 1995 sys_catalog.cc:564] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: configured and running, proceeding with master startup.
W20260808 02:44:17.873828 2111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 02:44:17.873998 2111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 02:44:17.869980 1923 master_runner.cc:186] Error getting master registration for 127.10.20.126:41019: OK, instance_id { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" instance_seqno: 1786157056466471 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 02:44:17.879989 1923 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 02:44:17.896746 2024 tablet.cc:2369] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:44:17.902350 1916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } attempt: 5
Aug 08 02:44:17 dist-test-slave-8tdl krb5kdc[1832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786157056, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.20.126@KRBTEST.COM for kudu/127.10.20.124@KRBTEST.COM
I20260808 02:44:17.920303 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.903194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.10.20.124:45219)
0808 02:44:17.903398 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:17.903404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:17.903553 (+ 149us) server_negotiation.cc:407] Connection header received
0808 02:44:17.903859 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:17.903865 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:17.903962 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:17.904067 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:17.905001 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.906232 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.907578 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.908322 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.908458 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.912998 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:17.913005 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:17.913008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:17.913047 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:17.916961 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.917795 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.917803 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.917808 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.917985 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:17.918558 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:17.918564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:17.918567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:17.918964 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:17.919123 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:17.919693 (+ 570us) server_negotiation.cc:299] Negotiation successful
0808 02:44:17.919932 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 02:44:17.920331 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:17.903142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.20.124:45219 (local address 127.0.0.1:53362)
0808 02:44:17.903430 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 02:44:17.903466 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 02:44:17.903653 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 02:44:17.904099 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 02:44:17.904103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 02:44:17.904641 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 02:44:17.904814 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.904823 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.906372 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.906378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.907414 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 02:44:17.907428 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 02:44:17.908713 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 02:44:17.908722 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 02:44:17.908935 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:17.909675 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 02:44:17.909703 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 02:44:17.912739 (+ 3036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 02:44:17.917190 (+ 4451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.917195 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.917198 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.917642 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.918143 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 02:44:17.918149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 02:44:17.918154 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 02:44:17.918407 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 02:44:17.919192 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 02:44:17.919198 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 02:44:17.919379 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 02:44:17.919535 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 02:44:17.919882 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
I20260808 02:44:17.928239 1916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b: Bootstrap starting.
I20260808 02:44:17.933215 1916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b: Neither blocks nor log segments found. Creating new log.
I20260808 02:44:17.934844 1916 log.cc:824] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b: Log is configured to *not* fsync() on all Append() calls
I20260808 02:44:17.945803 1916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b: No bootstrap required, opened a new log
I20260808 02:44:17.954195 1916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.954708 1916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af2bfe1d2a245f0a8da8363fc075a7b, State: Initialized, Role: FOLLOWER
I20260808 02:44:17.955329 1916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.956779 2114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:17.957545 2114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:17.958333 1916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 02:44:17.958406 1889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 02:44:17.958652 1889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:17.963439 1889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:17.967176 2047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "aedb9d7fabae415fbe7eee7da87925c1"
I20260808 02:44:17.967173 1970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c32374ec438f4fb1a107ac437307b8ee"
I20260808 02:44:17.967746 1970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:17.967746 2047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 02:44:17.971537 1970 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af2bfe1d2a245f0a8da8363fc075a7b in term 1.
I20260808 02:44:17.971537 2047 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af2bfe1d2a245f0a8da8363fc075a7b in term 1.
I20260808 02:44:17.972301 1863 leader_election.cc:302] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af2bfe1d2a245f0a8da8363fc075a7b, c32374ec438f4fb1a107ac437307b8ee; no voters:
I20260808 02:44:17.972756 1889 leader_election.cc:288] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [CANDIDATE]: Term 1 election: Requested vote from peers c32374ec438f4fb1a107ac437307b8ee (127.10.20.125:41143), aedb9d7fabae415fbe7eee7da87925c1 (127.10.20.124:45219)
I20260808 02:44:17.980140 2114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 02:44:17.993759 2114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [term 1 LEADER]: Becoming Leader. State: Replica: 5af2bfe1d2a245f0a8da8363fc075a7b, State: Running, Role: LEADER
I20260808 02:44:17.994935 2114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } }
I20260808 02:44:18.014393 2119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5af2bfe1d2a245f0a8da8363fc075a7b. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.015077 2119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:18.024216 2132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 02:44:18.038431 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:18.001996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38858 (local address 127.10.20.125:41143)
0808 02:44:18.002225 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.002234 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.004783 (+ 2549us) server_negotiation.cc:407] Connection header received
0808 02:44:18.006206 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.006213 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.006312 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.006399 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.012374 (+ 5975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:18.013510 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:18.018736 (+ 5226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:18.019474 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:18.019643 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:18.028484 (+ 8841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:18.028494 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:18.028500 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:18.028555 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:18.032675 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:18.034781 (+ 2106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:18.034788 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:18.034792 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:18.035000 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:18.035914 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:18.035922 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:18.035926 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:18.036357 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:18.036650 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:18.037738 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0808 02:44:18.038045 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 02:44:18.045601 2132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 02:44:18.047885 2076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:18.001452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53376 (local address 127.10.20.124:45219)
0808 02:44:18.001767 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.001776 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.007462 (+ 5686us) server_negotiation.cc:407] Connection header received
0808 02:44:18.013228 (+ 5766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.013234 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.013355 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.013445 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.026872 (+ 13427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:18.028374 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:18.031286 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:18.032461 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:18.032640 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:18.036851 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:18.036860 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:18.036865 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:18.036911 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:18.043715 (+ 6804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:18.044900 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:18.044907 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:18.044911 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:18.045093 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:18.045621 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:18.045628 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:18.045631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:18.046088 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:18.046402 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:18.047080 (+ 678us) server_negotiation.cc:299] Negotiation successful
0808 02:44:18.047428 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
W20260808 02:44:18.048820 1946 tablet.cc:2369] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 02:44:18.088032 2079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:18.004734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56782 (local address 127.10.20.126:41019)
0808 02:44:18.005000 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.005008 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.025158 (+ 20150us) server_negotiation.cc:407] Connection header received
0808 02:44:18.026904 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.026914 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.027074 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.027183 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.032717 (+ 5534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:18.033893 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:18.039315 (+ 5422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:18.041038 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:18.041225 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:18.061269 (+ 20044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 02:44:18.061281 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 02:44:18.061291 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 02:44:18.061374 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 02:44:18.067708 (+ 6334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:18.069315 (+ 1607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:18.069326 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:18.069333 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:18.069591 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 02:44:18.074216 (+ 4625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 02:44:18.074228 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 02:44:18.074234 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 02:44:18.074943 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 02:44:18.075512 (+ 569us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:18.086812 (+ 11300us) server_negotiation.cc:299] Negotiation successful
0808 02:44:18.087308 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 02:44:18.105122 2047 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [term 1 FOLLOWER]: Refusing update from remote peer 5af2bfe1d2a245f0a8da8363fc075a7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:44:18.107146 2119 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:44:18.110193 1970 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [term 1 FOLLOWER]: Refusing update from remote peer 5af2bfe1d2a245f0a8da8363fc075a7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 02:44:18.111099 2119 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 02:44:18.133834 2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5af2bfe1d2a245f0a8da8363fc075a7b. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.134168 2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:18.137547 2138 mvcc.cc:205] Tried to move back new op lower bound from 7316099309979340800 to 7316099309590822912. Current Snapshot: MvccSnapshot[applied={T|T < 7316099309979340800}]
I20260808 02:44:18.147792 2099 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5af2bfe1d2a245f0a8da8363fc075a7b. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.148193 2099 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:18.151868 2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.152168 2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:18.156404 2119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.156965 2119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:18.157401 2119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.157677 2119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b [sys.catalog]: This master's current role is: LEADER
I20260808 02:44:18.158779 2132 catalog_manager.cc:1347] Generated new cluster ID: 1e95297889384f89b76a5251f3d33c67
I20260808 02:44:18.158903 2132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 02:44:18.170786 2099 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af2bfe1d2a245f0a8da8363fc075a7b" member_type: VOTER last_known_addr { host: "127.10.20.126" port: 41019 } } peers { permanent_uuid: "c32374ec438f4fb1a107ac437307b8ee" member_type: VOTER last_known_addr { host: "127.10.20.125" port: 41143 } } peers { permanent_uuid: "aedb9d7fabae415fbe7eee7da87925c1" member_type: VOTER last_known_addr { host: "127.10.20.124" port: 45219 } } }
I20260808 02:44:18.171118 2099 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee [sys.catalog]: This master's current role is: FOLLOWER
I20260808 02:44:18.194973 2132 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 02:44:18.197373 2132 catalog_manager.cc:1504] Loading token signing keys...
I20260808 02:44:18.229436 2132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5af2bfe1d2a245f0a8da8363fc075a7b: Generated new TSK 0
I20260808 02:44:18.231153 2132 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 02:44:18.415665 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.409063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38866 (local address 127.10.20.125:41143)
0808 02:44:18.409267 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.409276 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.413262 (+ 3986us) server_negotiation.cc:407] Connection header received
0808 02:44:18.413625 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.413635 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.413754 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.413856 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.415370 (+ 1514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38866: BlockingRecv error: recv got EOF from 127.0.0.1:38866 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 02:44:18.418803 2079 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.408882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.10.20.126:41019)
0808 02:44:18.409101 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.409109 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.416537 (+ 7428us) server_negotiation.cc:407] Connection header received
0808 02:44:18.416890 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.416898 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.417034 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.417135 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.418419 (+ 1284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56798: BlockingRecv error: recv got EOF from 127.0.0.1:56798 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 02:44:18.421636 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.415490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53384 (local address 127.10.20.124:45219)
0808 02:44:18.415684 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.415691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.419668 (+ 3977us) server_negotiation.cc:407] Connection header received
0808 02:44:18.419986 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.419992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.420096 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.420182 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.421363 (+ 1181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53384: BlockingRecv error: recv got EOF from 127.0.0.1:53384 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 02:44:18.437354 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.429164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38870 (local address 127.10.20.125:41143)
0808 02:44:18.429420 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.429427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.435498 (+ 6071us) server_negotiation.cc:407] Connection header received
0808 02:44:18.435825 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.435831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.435971 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.436120 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.437074 (+ 954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38870: BlockingRecv error: recv got EOF from 127.0.0.1:38870 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260808 02:44:18.449108 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.445067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38878 (local address 127.10.20.125:41143)
0808 02:44:18.445408 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.445419 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.447358 (+ 1939us) server_negotiation.cc:407] Connection header received
0808 02:44:18.447624 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.447631 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.447730 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.447876 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.448755 (+ 879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38878: BlockingRecv error: recv got EOF from 127.0.0.1:38878 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260808 02:44:18.460567 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.458144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38880 (local address 127.10.20.125:41143)
0808 02:44:18.458417 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.458430 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.459004 (+ 574us) server_negotiation.cc:407] Connection header received
0808 02:44:18.459242 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.459253 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.459337 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.459459 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.460278 (+ 819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38880: BlockingRecv error: recv got EOF from 127.0.0.1:38880 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 02:44:18.470623 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.468083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38886 (local address 127.10.20.125:41143)
0808 02:44:18.468410 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.468420 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.468979 (+ 559us) server_negotiation.cc:407] Connection header received
0808 02:44:18.469230 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.469235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.469311 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.469443 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.470330 (+ 887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38886: BlockingRecv error: recv got EOF from 127.0.0.1:38886 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
W20260808 02:44:18.511186 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.508707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.10.20.125:41143)
0808 02:44:18.508951 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.508980 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.509625 (+ 645us) server_negotiation.cc:407] Connection header received
0808 02:44:18.509860 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.509865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.509982 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.510103 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.510938 (+ 835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38898: BlockingRecv error: recv got EOF from 127.0.0.1:38898 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 02:44:18.534148 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.531614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38904 (local address 127.10.20.125:41143)
0808 02:44:18.531875 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.531884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.532448 (+ 564us) server_negotiation.cc:407] Connection header received
0808 02:44:18.532678 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.532691 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.532778 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.532889 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.533831 (+ 942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38904: BlockingRecv error: recv got EOF from 127.0.0.1:38904 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 02:44:18.573969 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.571358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38920 (local address 127.10.20.125:41143)
0808 02:44:18.571589 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.571599 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.572197 (+ 598us) server_negotiation.cc:407] Connection header received
0808 02:44:18.572470 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.572479 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.572625 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.572761 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.573676 (+ 915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38920: BlockingRecv error: recv got EOF from 127.0.0.1:38920 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 02:44:18.644171 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.642037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.10.20.125:41143)
0808 02:44:18.642273 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.642280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.642602 (+ 322us) server_negotiation.cc:407] Connection header received
0808 02:44:18.642805 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.642812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.642937 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.643068 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.643909 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38924: BlockingRecv error: recv got EOF from 127.0.0.1:38924 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 02:44:18.778000 2081 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 02:44:18.775832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38932 (local address 127.10.20.125:41143)
0808 02:44:18.776092 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:18.776098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:18.776407 (+ 309us) server_negotiation.cc:407] Connection header received
0808 02:44:18.776527 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:18.776531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:18.776624 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:18.776726 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 02:44:18.777638 (+ 912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38932: BlockingRecv error: recv got EOF from 127.0.0.1:38932 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 02:44:18.783172 2095 catalog_manager.cc:1259] Loaded cluster ID: 1e95297889384f89b76a5251f3d33c67
I20260808 02:44:18.783283 2095 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: loading cluster ID for follower catalog manager: success
I20260808 02:44:18.786021 2095 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: acquiring CA information for follower catalog manager: success
I20260808 02:44:18.789515 2095 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aedb9d7fabae415fbe7eee7da87925c1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:44:18.876516 2111 catalog_manager.cc:1259] Loaded cluster ID: 1e95297889384f89b76a5251f3d33c67
I20260808 02:44:18.876641 2111 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: loading cluster ID for follower catalog manager: success
I20260808 02:44:18.879352 2111 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: acquiring CA information for follower catalog manager: success
I20260808 02:44:18.881299 2111 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c32374ec438f4fb1a107ac437307b8ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 02:44:19.047216 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:19.040558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38938 (local address 127.10.20.125:41143)
0808 02:44:19.040749 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:19.040754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:19.041177 (+ 423us) server_negotiation.cc:407] Connection header received
0808 02:44:19.041277 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:19.041281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:19.041450 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:19.041567 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:19.042146 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.042968 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.044514 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.044973 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.045091 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:19.045713 (+ 622us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:19.046317 (+ 604us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:19.046467 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:19.046787 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 02:44:19.046891 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 02:44:19.060964 2214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:19.054354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53390 (local address 127.10.20.124:45219)
0808 02:44:19.055345 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:19.055352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:19.055370 (+ 18us) server_negotiation.cc:407] Connection header received
0808 02:44:19.055470 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:19.055474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:19.055622 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:19.055813 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:19.056243 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.056998 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.058363 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.058904 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.059044 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:19.059604 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:19.060235 (+ 631us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:19.060404 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:19.060516 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 02:44:19.060609 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":748,"threads_started":1}
I20260808 02:44:19.075866 2214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:19.068539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53398 (local address 127.10.20.124:45219)
0808 02:44:19.068713 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:19.068719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:19.069653 (+ 934us) server_negotiation.cc:407] Connection header received
0808 02:44:19.069895 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:19.069900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:19.069984 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:19.070087 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:19.070634 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.071557 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.073487 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.074126 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.074224 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:19.074998 (+ 774us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:19.075160 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:19.075228 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:19.075475 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 02:44:19.075576 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 02:44:19.083465 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:19.068421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.10.20.125:41143)
0808 02:44:19.068656 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:19.068662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:19.076829 (+ 8167us) server_negotiation.cc:407] Connection header received
0808 02:44:19.077076 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:19.077083 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:19.077171 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:19.077229 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:19.077867 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.079022 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.081154 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.081882 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.081976 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:19.082619 (+ 643us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:19.082787 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:19.082848 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:19.083058 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 02:44:19.083156 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 02:44:19.093461 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 02:44:19.068250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56812 (local address 127.10.20.126:41019)
0808 02:44:19.084291 (+ 16041us) server_negotiation.cc:206] Beginning negotiation
0808 02:44:19.084302 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 02:44:19.084328 (+ 26us) server_negotiation.cc:407] Connection header received
0808 02:44:19.084485 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 02:44:19.084494 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 02:44:19.084798 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 02:44:19.086111 (+ 1313us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 02:44:19.087199 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.088442 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.090728 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 02:44:19.091422 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 02:44:19.091559 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 02:44:19.092187 (+ 628us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 02:44:19.092720 (+ 533us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 02:44:19.092828 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 02:44:19.093009 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 02:44:19.093111 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15858,"thread_start_us":17506,"threads_started":1}
I20260808 02:44:19.104156 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1845
I20260808 02:44:19.105437 1911 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:19.221007 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1845
I20260808 02:44:19.247726 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 1923
I20260808 02:44:19.249102 1990 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:19.364763 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 1923
I20260808 02:44:19.391489 10321 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu pid 2003
I20260808 02:44:19.392910 2068 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 02:44:19.507833 10321 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksj7NWU/build/asan/bin/kudu with pid 2003
2026-08-08T02:44:19Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5222 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10596 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (425854 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST